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Abstract 

This work explores Lyapunov characterizations of the input-output-to-state stabihty (lOSS) 
property for nonhnear systems. The notion of lOSS is a natural generalization of the standard 
zero-detectability property used in the linear case. The main contribution of this work is to 
establish a complete equivalence between the input-output-to-state stability property and 
the existence of a certain type of smooth Lyapunov function. As corollaries, one shows the 
existence of "norm-estimators" , and obtains characterizations of nonlinear detectability in 
terms of relative stability and of finite-energy estimates. 

1 Introduction 

This paper concerns itself with the following question, for dynamical systems: is it possible to 
estimate, on the basis of external information provided by past input and output signals, the 
magnitude of the internal state x{t) at time t? The rest of this introduction will explain, in 
very informal and intuitive terms, the motivation for this question, closely related to the "zero 
detectability" problem, sketching the issues that arise and the main results. Precise definitions 
are provided in the next section. 

State estimation is central to control theory. It arises in signal processing applications 
(Kalman filters), as well as in stabilization based on partial information (observers). By and 
large, the theory of state estimation is well-understood for linear systems, but it is still poorly 
developed for more general classes of systems, such as finite-dimensional deterministic systems, 
with which this paper is concerned. An outstanding open question is the derivation of useful 
necessary and sufficient conditions for the existence of observers, i.e., "algorithms" (dynamical 
systems) which converge to an estimate x(t) of the state x{t) of the system of interest, using 
the information provided by {u{s),s < t}, the set of past input values, and by {y{s),s < t}, 
the set of past output measurements. In the context of stabilization to an equilibrium, let us 
say to the zero state a; = if we are working in an Euclidean space, a weaker type of estimate 
is sometimes enough: it may suffice to have a norm-estimate, that is to say, an upper bound 
x{t) on the magnitude (norm) \x{t)\ of the state x{t). Indeed, it is often the case (cf. [^] and 
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Assumption UEC (73) in ||T9[) that norm-estimates suffice for control appUcations. To be more 
precise, one wishes that x{t) becomes eventuahy an upper bound on \x{t)\ as t ^ oo. We are 
thus interested in norm- estimators which, when driven by the i/o data generated by the system, 
produce such an upper bound x{t), cf. Figure |l|. 




Figure 1: Norm-Estimator 



In order to understand the issues that arise, let us start by considering the very special 
case when the external data (inputs u and outputs y) vanish identically. The obvious estimate 
(assuming, as we will, that everything is normalized so that the zero state is an equilibrium for 
the unforced system, and the output is zero when x = 0) is x{t) = 0. However, the only way 
that this estimate fulfills the goal of upper bounding the norm of the true state as t ^ oo is if 
x{t) 0. In other words, one obvious necessary property for the possibility of norm-estimation 
is that the origin must be a globally asymptotically stable state with respect to the "subsystem" 
consisting of those states for which the input u = produces the output y = 0. One says in 
this case that the original system is zero- detectable. For linear systems, zero detectability is 
equivalent to detectability, that is to say, the property that if any two trajectories produce the 
same output, then they approach each other. Zero-detectability is a central property in the 
general theory of nonlinear stabilization on the basis of output measurements; see for instance, 
among many other references, [35, 18, 5C, 11, 17|. Our work can be seen as a contribution 



towards the better characterization and understanding of this fundamental concept. 

However, zero-detectability by itself is far from being sufficient for our purposes, since it 
fails to be "well-posed" enough. One easily sees that, at the least, one should ask that, when 
inputs and outputs are small, states should also be small, and if inputs and outputs converge 
to zero as t — > oo, states do too, cf. Figure 0. Moreover, when defining formally the notion 
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Figure 2: State Converges to Zero if External Data does 



of norm-estimator and the natural necessary and sufficient conditions for its existence, other 
requirements appear: the existence of asymptotic bounds on states, as a function of bounds on 
input/output data, and the need to describe the "overshoot" (transient behavior) of the state. 

One way to approach the formal definition, so as to incorporate all the above characteristics 
in a simple manner, is to look at the analogous questions for the stability problem, which, for 
linear systems, is known to be technically dual to detectability. This leads one to the area 
which deals precisely with this circle of ideas: input-to- state stability (iss). 

Input-to-state stability was introduced in |37|, and has proved to be a very useful paradigm 
in the study of nonlinear stability; see for instance the textbooks [17, 21, 23, 24[, and the 
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papers |llO|, [15 Jl6 J20|, p9| , |T^, 33, 34, 44, 42, 49, |4^, as well as its variants such as integral 
ISS (cf. irHTs^ and input/output stability (cf. [|^, |4|, |^). The notion of ISS takes 
into account the effect of initial states in a manner fully compatible with Lyapunov stability, 
and incorporates naturally the idea of "nonlinear gain" functions; the reader may wish to 
consult |4^ for an exposition — as well as for several new characterizations obtained after 
that exposition was written. Roughly speaking, a system is iSS provided that, no matter what is 
the initial state, if the inputs are small, then the state must eventually be small. Dualizing this 
definition one arrives at the notion of detectability which is the main subject of study of this 
paper: input/output to state stability (lOSS). (The terminology "lOSS" is not to be confused 
with the totally different concept called input/output stability (lOS), cf. 45, which 
refers instead to stability of outputs, rather than to detectability.) 

A system x = f{x,u) with measurement ("output") map y = h{x) is lOSS if there are some 
functions j3 G ICC and 71,72 G A^oo such that the estimate: 

\x{t)\ < max{/?(|x(0)| ,t),7i (||n|[o,t] ||) ,72 (||y|[o,t]||)} 

holds for any initial state x{0) and any input u{-), where x(-) is the ensuing trajectory and 
y{t) = h{x{t)) the respective output function. (States x{t), input values u{t), and output 
values y{t) lie in appropriate Euclidean spaces. We use |-| to denote Euclidean norm and 
II -11 for supremum norm. Precise definitions and technical assumptions are discussed later.) 
The terminology lOSS is self-explanatory: formally there is "stability from the i/o data to 
the state". The term was introduced in the paper |47|, but the same notion had appeared 
before: it represents a natural combination of the notions of "strong" observability (cf. |p7| ) 
and ISS, and was called simply "detectability" in |4^ (where it is phrased in input /output, as 
opposed to state space, terms, and applied to questions of parameterization of controllers) and 
was called "strong unboundedness observability" in (more precisely, this last notion allows 



also an additive nonnegative constant in the right-hand side of the estimate). In |47|, two of 
the authors described relationships between the existence of full state observers and the lOSS 
property, or more precisely, a property which we called "incremental lOSS" . The use of iSS-like 
formalism for studying observers, and hence implicitly the lOSS property, has also appeared 
several times in other authors' work, such as the papers |^, p7| . 

One of the main results of this paper is that a system is lOSS if and only if it admits a norm- 
estimator (in a sense also to be made precise). This result is in turn a consequence of a necessary 
and sufficient characterization of the lOSS property in terms of smooth dissipation functions, 
namely, there is a proper (radially unbounded) and positive definite smooth function V of 
states (a "storage function" in the language of dissipative systems introduced by Willems |52| 



and further developed by Hill and Moylan |14| , |13| and others) such that a dissipation inequality 



di 



V{xit)) < -a^{\xit)\) + a^imi) + ^3{\um 



(1) 



holds along all trajectories, with the functions ai of class /Coo- This provides an "infinitesimal" 
description of lOSS, and a norm-observer is easily built from V. Such a characterization in 
dissipation terms was conjectured in |^^, and we provide here a complete solution to the 
problem. (The paper [^] also explains how the existence of V links the lOSS property to 
"passivity" of systems.) 

It is worth pointing out that several authors had independently suggested that one should 
define "detectability" in dissipation terms. For example, in [^], Equation 15, one finds de- 
tectability defined by the requirement that there should exist a differentiable storage function 
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V satisfying our dissipation inequality but with the special choice (T2(r) := (there were no 
inputs in the class of systems considered there) . A variation of this is to weaken the dissipation 
inequality, to require merely 



x^O ^ -V{x{t))<a2{\ym 



(again, with no inputs), as done for instance in the definition of detectability given in [31|. 
Observe that this represents a slight weakening of our property, in so far as there is no "margin" 
of stability — C7i(|x(t)|). One of our contributions is to show that such alternative definitions 
(when posed in the right generality) are in fact equivalent to lOSS. 

A key preliminary step in the construction of V, just as it was for the analogous result for the 
ISS property obtained in is the characterization of the lOSS property in robustness terms, by 
means of a "small gain" argument. The lOSS property is shown to be equivalent to the existence 
of a "robustness margin" p £ /Coo- This means that every system obtained by closing the loop 
with a feedback law A (even dynamic and/or time-varying) for which |A(f)| < p{\x{t)\) for all 
t, cf. Figure H, is OSS (i.e., is lOSS as a system with no inputs). In order to formulate precisely 




Figure 3: Robust Detectability 



this notion of robust detectability, we need to consider auxiliary "systems with disturbances". 
Since such systems must be introduced anyhow, we decided to present all our results (and 
definitions, even of lOSS) for systems with disturbances, in the process gaining extra generality 
in our results. 

The core of the paper is, thus, the construction of V for "robustly detectable" (more pre- 
cisely, "robust loss") systems x = g{x,d) which are obtained by substituting u = dp{\x\) 
in the original system, and letting d = d{-) be an arbitrary measurable function taking 
values in a unit ball. The function V must satisfy a differential inequality of the form 
V{x{t)) < — (Ti(|x(t)|) -|- (T2(|y(t)|) along all trajectories, that is to say, the following partial 
differential inequality: 

VV{x)-g{x,d) < -a^{\x\) + a2{\y\) , 

for some functions ai and a2 of class /Coo- But one last reduction consists of turning this problem 
into one of building Lyapunov functions for "relatively asymptotically stable" systems. Indeed, 
one observes that the main property needed for V is that it should decrease along trajectories as 
long as y{t) is sufficiently smaller than x{t). This leads us to the notion of "global asymptotic 
stability modulo outputs" and its Lyapunov-theoretic characterization. 

The construction of V relies upon the solution of an appropriate optimal control problem, 
for which V is the value function. This problem is obtained by "fuzzifying" the dynamics near 
the set where y <C x, so as to obtain a problem whose value function is continuous. Several 
elementary facts about relaxed controls are used in deriving the conclusions. The last major 
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ingredient is the use of techniques from nonsmooth analysis, and in particular inf-convolutions, 
in order to obtain a Lipschitz, and from there by a standard regularization argument, a smooth, 
function V, starting from the continuous V that was obtained from the optimal control problem. 

Finally, we will also discuss a version of detectability which relies upon "energy" estimates 
instead of uniform estimates. Such versions of detectability are fairly standard in control theory; 



see for instance |11], which defined "L^-detectability" by a requirement that the state trajectory 
should be in if the observations are. The corresponding "integral to integral" notion uses a 
very interesting concept introduced in |^0|, that of "unboundedness observability" (UO), which 
amounts to a "relative (modulo outputs) forward completeness" property. It is shown that, for 
systems with no controls, the integral variant of OSS is equivalent to the conjunction of OSS and 
UO. 

It is worth remarking that the main result in this paper amounts to providing necessary and 
sufficient conditions for the existence of a smooth (and proper and positive definite) solution 
y to a partial differential inequality which is equivalent to asking that holds along all 
trajectories, namely: 

max{VVix)- fix,u) + aii\x\)-a2i\h{x)\)-a3i\u\)} < 0. (2) 

It is a consequence of our results that if there is an (even just) lower semicontinuous such 
solution (when "solution" is interpreted in a weak sense, for example in terms of viscosity or 
proximal subdifferentials), then there is also a smooth solution (usually, however, with different 
comparison functions crj's). This is because the existence of a weak solution is already equivalent 
to loss, as shown in |^]. It is a routine observation that the above partial differential inequality 
can be posed in an equivalent way as a Hamilton- J acohi Inequality (HJI), in the special case of 
quadratic input "cost" (Ts{r) = r^, and for systems x = f{x,u) which are affine in controls, i.e. 
systems of the form: 

m 

X = 30(2;) + ^ Uigi{x) (3) 

i=l 

(we are denoting by Ui the ith. component of u). Indeed, one need only replace the expression 
in by its maximum value obtained at Uj = {l/2)\/V{x)-gi{x), i = 1, . . . m, thereby obtaining 
the following HJI: 

^ m 

VV{x) ■ go{x) + - J2{VV{x) ■ gi{x)f + ai{\x\) - a2{\h{x)\) < . (4) 

i=l 



2 Definitions and statements of the main results 



2.1 Systems of interest 

We study a system whose dynamics depend on two types of inputs, which we call respectively 
controls and disturbances: 



x(t) = /(x(t),u(t),w(t)), y{t) = h{x{t)). (5) 

Here, states evolve in X = M", controls are measurable, essentially bounded functions u on 
X = M>o with values in U := M"*", and disturbances are measurable functions w : T — > F 
with values in a compact metric space F (which, unless otherwise specified, is always taken to 
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be of the form [—1, 1]"*™); we will denote the set of all such functions by A^r- In those cases 
when a different interval X C ]R>o of definition for a control u is specified, we always apply the 
definitions to the extension of u to M>o, using u = on M>o\X. The function / : XxUxF^X 
is locally Lipschitz in (x,n) uniformly on jointly continuous in x, n, and and such that 
/(0, 0, u;) =0 for any w and /i : X ^ := is smooth (C^) and vanishes at 0. 

A function a : M>o K>o is of class K. if it is continuous, positive definite, and strictly 
increasing, and is of class /Coo if it is also unbounded. A function /? : M>o x M>o — > M>o is said 
to be of class ICC if for each fixed t > 0, l3{-,t) is of class /C, and for each fixed s > 0, P{s,t) 
decreases to as t ^ cxd. Let z{-) be a measurable function. 

The Loo (essential supremum) norm of the restriction of z to the interval [ti,t2] is denoted 

by Il^l[ii,t2]||- 

Given a state ^ G X, for each pair (u, w) denote by x{t, ^, u, w) the unique maximal solution 
of the system @, which is defined on some maximal interval [0, imax(?) u, w)). We will use the 
notation y(t,^,u,w) := ^, u, w)), and, when unimportant or clear from the context, 

we will write tmax instead of tmaxlC) u, w), x(t) instead of x(t,^,u, w) and y{t) instead of 
y(t,^,u,w). 

2.2 Notions of "Uniform Detectability" and dissipation functions 

Definition 2.1 A system of type (||) is said to be uniformly input- output-to- state stable 
(UIOSS) if, there exist functions f3 G ICC and 71,72 G such that the estimate: 

|x(t,^,u,w)| < max{/3(|^| ,t),7i (||u|[o,i]||) ,72 (||y|[o,t]||)} (6) 
holds for any initial state ^ G X, control u, disturbance w, and time t G [0, fmax(C, u, w)). 

Definition 2.2 A smooth {C°°) function 1/ : X ^ M>o is an UIOSS-Lyapunov function for 
system ^ if: 

• there exist /Coo-functions ai, 02 such that 

aim < vio < «2(iei) (7) 

holds for all ^ in X, and 

• there exists a /Coo-function a and /C-functions ci, a2 such that 

VV{0-f{^,u,w) < + a,{\u\) + a2{\h{0\) (8) 

for all in X, all control values n G U, and all disturbance values w GT. □ 

Property (|^ amounts to positive definiteness and properness of V; requiring the existence 
of an upper bound 02 is redundant, as it follows from the fact that V is continuous and satisfies 
V{0) = 0. However, it is convenient to specify this bound explicitly, as it will be used in various 
estimates. Condition (pi) is a dissipation inequality in the sense of jS^. 
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Remark 2.3 A smooth function F : X ^ ^>o, satisfying (|^ on X with some ai, 02 of class 
/Coo, is an UlOSS-lyapunov function for a system (|5|) if and only if there exist functions 03 of 
class /Coo, and 7, and xi of class fC such that 

for any ^ G X, w £ T, and n G U such that |.^| > xi(l^l)- 

Indeed, clearly (^) implies with a3(-) := a(-)/2, 7 = a2, and xi := ° (2o"i). To prove 
the other implication, assume now that @ holds with some 03 G /Coo and 7, xi ^ Define 
(Ti(-) = max{0, (fi(-)}, where 

<fi(r) := max{Vy(^) • f{^,u,w) + a3(xi(|n|)) : \u\ < r, \^\ < Xi{r),w G F} . 

Then ai is continuous, cri(O) = 0, and one can assume that ai is a /Coo-function (majorize it 
by one if it is not). We claim that (|8|) holds with a = as and a2 = 7. Indeed, if |^| > xid'^Di 
then (^) holds, from which trivially follows. If |^| < xi(|^|)i then, by definition of ai, 

cTi{\u\) > VV{0 ■ f{C,u,w) + a3{xi{\u\)) 

for every w, which, in turn, implies (^). □ 



A few particular cases of the UIOSS property have been studied in the literature. If the 
system (^) in consideration has no outputs and no disturbances, UIOSS reduces to the well- 
known ISS property, whose Lyapunov characterization was obtained in [^2|. In case (|5|) is 
autonomous, UIOSS becomes OSS. This property was introduced in |43| where Lyapunov-type 
necessary and sufficient conditions were obtained. Finally, for systems with no disturbances, 
UIOSS is just loss. This property was introduced in [47], where it was conjectured that any 
lOSS control system admits a smooth lOSS-Lyapunov function. This conjecture will be proven 
here in a more general setting, for systems forced by both controls and disturbances. A few 
interesting applications of this Lyapunov characterization were also discussed in [47], one of 
them to be defined next. 



2.3 Norm estimators 

Definition 2.4 A state-norm estimator (or state-norm observer) for a system S of type (|5|) is 
a pair (Sn.o, k{-, •)), where /c : x 3^ ^ M, and S„.o is a system 

P = 9{p,u,y) (10) 

evolving in and driven by the controls and outputs of S, such that the following conditions 
are satisfied: 



• There exist /C-functions 71 and 72 and a /C£-function /? such that for any initial state 
G M^, all inputs u and y, and any t in the interval of definition of the solution p{-, u, y), 
the following inequality holds 

\k{p{t,C,n,y),ym < /3(1C1 , t) + 71 (||ul[o,t] ||) +72(||yl[o,dl) (H) 
(in other words, the system (p!o|) is lOS with respect to the inputs u and y and output k). 
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There are functions p ^ K, and (3 G KC so that, for any pair of initial states and Q 
of systems @ and (10) respectively, any control u : ]R>o U, and any disturbance 



w E A^F) we have 

\x{t, u, w)i < + Id , i) + pmpit, c, u, yc,u,w), y€,u,w(t))i) (12) 

for all t £ [0, tmax('^, u, vif)). (Here y5,u,w denotes the output trajectory of S, that is, 

yc,u,w(t) = y(i,^,u,w).) □ 

2.4 Statement of the main result 

The main theorem to be proved in this paper, summarizing the equivalent characterizations of 
UIOSS , will be as follows: 

Theorem 1 Let S 6e a system of type Then the following are equivalent: 

1. T.is UIOSS. 

2. S admits an UIOSS-Lyapunov function. 

3. There is a state-norm estimator for S. I 

The main contribution is in showing that 1 implies 2; the remaining implications are much 
easier. 

2.5 Example: linear systems 

A particular class of systems (^ is as follows. A linear, time-invariant system TiHn with outputs 
is one for which / and h are linear, that is, 

X = Ax + Bu (13) 

y = Cx, 

where A € M'^^'^, B G M"^"", and C G R^^". (We assume that = 0.) 
Recall: 



Definition 2.5 A linear, time invariant system (13) is detectable, or asymptotically observable, 
if the following implication 

Cx{t) = ^ x{t) (14) 
holds for any trajectory x{t) of (|l3|), corresponding to the zero control u = 0. □ 

This is a totally routine linear systems theory fact, but we include the proof as a motivation 
for the nonlinear material to follow. 



Proposition 2.6 If a linear system ( |13D is detectable, then it is lOSS. 
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Proof. It is a well known fact (see, for example, |^^) that if a system (|T3|) is detectable, then 
there exists a matrix L E M"^^, such that the matrix A + LC is Hurwitz, and, furthermore, 
the system 

z{t) = Az{t) + Bu{t) + L{Cz{t) - y{t)) (15) 

referred to as an observer and driven by the controls and outputs of (|l3|), has the property that 
if x{t) and z{t) are any solutions of (^) and ( p^ ) respectively, then \x{t) — z{t)\ — > 0, and, in 
particular, if x(0) = z{0), then x{t) = z(t) for all nonnegative t. Fix an initial state ^ and a 
control u. Then the solution x(t, u) of ([l3D is also the solution of (|l^) with z{0) = ^, so that 



x{t, u) = e*(^+^*^)^ + r e^(A+LC) [Bu(t - s) - Ly(t - s)]ds. 

Jo 

Choose two positive numbers 5' and 5 so that 5RA < —5' < —6 for every eigenvalue A of A + LC. 
Then there exists a polynomial P(-) and, consequently, a constant -fC such that 

|x(t,C,u)| < P(t)e-'^'* Id + rP(s)e-^'^[||B|||u(t-s)| + ||L|||y(t-s)|](is 

Jo 

< Ke-'' lel + ||u|^Q^^j II + ||y|^Q^^j II . 



Thus, the lOSS estimate (|6|) holds for ( p!3| ) with the linear gains P{r,t) := Ke ^^r and 71 (r) = 
72(r):=/rMr. I 

To find an lOSS-Lyapunov function for system ([l^), take any symmetric matrix P G M"^" 
such that 

P(A + LC) + (A + LC)'P = -/ 

(such a matrix P exists, because A + LC is Hurwitz). Define 

V{x) := x'Fx (16) 

Notice that, since P(A + LC) = ((A + LC)'P)', we have x'P(A + LC)x = x'{A + LC)'Px. 
Therefore 

VV{x)-f{x,u) = 2x'P(Ax + Bn) 

= 2x'P((A + LC)x + Bn-Ly) 

= 2x'P(A + LC)x + 2x'PBu - Ix'PLy 

= x'(P(A + LC) + (A + LC)'P)x + 2x'PBn - 2x'PLy 

< - |x|^ + 2 ||P|| ||B|| \u\ \x\ + 2 ||P|| ||L|| \y\ \x\ 

< - |x|^ + |x|V4 + 4||Pf ||Bf lup + |x|V4 + 4||Pf ||Lf \y\^ 

< - |x|V2 + 4||Pf ||Bf |u|V4||Pf ||Lf \yf. 

So, the UIOSS dissipation inequality holds for V with gains defined by a(r) = r/2, ai{r) = 
4||Pf ||Bf r^^ o-2(r) = 4||Pf ||Lf r^. 

2.6 Systems without controls 

Let be a compact metric space (which is always assumed to be of the form [—1, 1]™" unless 
specified otherwise) . Consider systems of the type 

x = f{x{t),d{t)), y{t) = h{x{t)), (17) 
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where / : X x 17 is locally Lipschitz in x uniformly on d and jointly continuous in x and d, and 
/(O, d) = for any d G O. The inputs are measurable functions d : X — > fi, and we use the 
term disturbances to refer to such fi-valued inputs. We will use to denote the collection of 
all such functions. 

This system can be seen as a particular case of (H) that eschews controls and is driven only 
by disturbances. However, it will play an important role in our studies, therefore for convenience 
we will define the corresponding stability property and dissipation inequality for this system 



separately from the main definition 2.1 



Definition 2.7 A system (|l7| ) is uniformly output-to- state stable (UOSS) if there exist some 
(3 G K.C and 72 G /C such that 

\x{t,i,d)\ < max{/3(|e| ,t),72 (||y|[o,t]||)} (18) 
for any disturbance d, initial state C ^ aiid t G [0, tmax)- 



Definition 2.8 A UOSS-Lyapunov function for system ( [l7|) is a smooth function 1/ : X — > IR>o 
satisfying (^) and 

Vy(x) • /(x,d) < -a3(|x|) +7(|/i(x)|) Vx G X, Vd G J], (19) 

with some class /Coo functions ai and a /C function 7. For systems with no disturbances we 
simply say that V is an OSS-Lyapunov function. □ 



2.6.1 "Modulo outputs" relative stability 

Recall the classical notion of uniform global asymptotic stability for systems of type (pT[), 
ensuring that every solution of the system tends to the equilibrium and never goes too far from 
it. Suppose now that it does not matter how the system behaves when the information provided 
by the output is adequate, that is, the norm of the output dominates the norm of the current 
state. On the other hand, we want the system to decay nicely when the output does not help 
in determining how large the state is. This motivates the following "modulo output" definition 
of stability. 



Definition 2.9 A system of type ( p^D satisfies the GASMO (global asymptotic stability modulo 
output) property if there exist a function p of class /Coo and a function A of class ICC, such that, 
for all ^ G X, d G j^n, and any T < tmax(C) d), if 

|x(t,e,d)| >p(|Mx(t,C,d))|) vo<t<r, 

then the estimate 

|x(t,^,d)| < A(|^| ,t) VO<t<r. (20) 
holds. □ 



Remark 2.10 If a system in consideration has no outputs, then the GASMO property becomes 
global asymptotic stability (GAS). 
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The following proposition provides an "e-(5" characterization of the GASMO property. 



Proposition 2.11 A system of type ( |17| ) satisfies the GASMO property if and only if there 
exists a /Coo-function p so that the following two properties hold: 

1. For any e > and any r > 0, there exists some T^._e such that for any |^| < r, any d, and 
any T G [0, tmax(C) d)) such that T > T^^e-, if 

|x(t,e,d)| > p{\y{t, i,d)\) forallO<t<T, 

then 

\x{t, C,d)| < e for ah te[Tr^e,T]. 

2. There exists a /C-function i? such that for any ^ G X, any disturbance d, and any T < 
*max(C)d) such that 

|x(t,e,d)| > p{\y{t,i,d)\) for all 0<t<r, 
the following "bounded overshoot" estimate holds: 

ix(T,e,d)i < m\)- 

The necessity part is obvious. To prove the sufficiency, we need the following lemma, proved 
in section 3 of [^], although not explicitly stated in this form: 

Lemma 2.12 Let <l'(r, t) : (M>o)^ M>o be a map such that 

1. for all e > and for all > there exists T such that $(r, t) < e for all < r < and 
for all t > T, 

2. for all e > there exists 6 > such that if r < 5 then <I>(r, t) < e for all t > 0. 

Then <I> can be majorized by a ICC- function. □ 



Proof of sufficiency for Proposition \2.11 . Consider the function: 

^{r,t) := sup{|x(t,C,d)| : |e| < r, d G M^, \x{s,i,d)\ > d)|) Vs G [0,t]} 



Then the conditions 1) and 2) of Lemma 2.12 follow from the assumptions 1) and 2) of the 
proposition, so that one can majorize $ by a /C£-function A. I 

Suppose a system S of type ( p^ satisfies the GASMO property with some /Coo function p. 
By majorizing p by another /Cqo function if necessary, we will assume that p is smooth when 
restricted to s > and also p{s) > s for all positive s. We let 

V:= {CGX: |C| < , 

£ := X\V, 

and 

£,:={CeX: \C\>2p{\hm} ■ 
For each d £ M.q and ^ G <f , define 

A5,d = inf {t G [0, W) : x{t, ^, d) G P} , (21) 

with the convention A^^d = tmax('^i d) if the trajectory never enters P. 
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2.6.2 Integral variants 

The UOSS property gives uniform estimates on states as a function of uniform bounds on 
outputs. There is a "finite energy output imphes finite energy state" version as well: 



Definition 2.13 A system of type ( p^ is integral to integral uniformly output to state stable 
(iiUOSS) if there exist functions 7, k of class /C and x £ ^00 such that 



L 



\{\x{s,iA)\)ds < [\{\h{x{s,^,dmds (22) 

'0 Jo 

for any initial state ^, any disturbance d G Mq, and any time t G [0, tinax('C) d)). □ 
Without loss of generality, 7 and k can be assumed to be of class /Coo- 

Definition 2.14 A system (|5|) is called forward complete if for every initial condition ev- 
ery input signal u, and every disturbance d defined on [0,+oo), the corresponding trajectory 
x{t,^,u,d) is defined for all t>0, i.e. tinax(C)U, d) = +cxd. □ 

The following property, which is strictly weaker than forward completeness, was introduced 

in 



Definition 2.15 A system (^) has the unboundedness observability property (UO) if 

limsup |y(t,^,d)| = +00 (23) 

holds for each initial state ^ and disturbance d with tmax(C,d) < 00. □ 
The following useful characterization of UO was provided in . 

Proposition 2.16 A system ( p!7| ) has the UO property if and only if there exist class /C func- 
tions pi, xii X2i and a constant c, such that the following implication holds: 

IMx(t,c,d))| <pi(|x(t,e,d)|) vte[o,r] |x(t,^,d)| <xi(t) + x2(iei) + c vtG[o,r], 

(24) 

for alU G X, d G Mq, and all T G [0, tmax(C, d)). □ 

This proposition provides a uniform bound on all the states that can be reached by a UO 
system in given time from a given bounded set via a trajectory not dominated by the output. 
Notice that for systems with disturbances ^P\), the U OSS property implies the U O property. 



2.6.3 Statement of the main result for the case of no inputs 



Theorem 2 Let H be a system of type Then the following are equivalent: 

1. ^ is UOSS. 

2. S is GASMO. 

3. S is iiUOSS and UO. 

4- S admits an UOSS-Lyapunov function. 
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2.7 Organization of the paper 



Implications ^ ^ ^ |T| of Theorem |l| are proven in section ^. The most difficult to prove 
part of Theorem |l| is the implication |l| =^ |2|. The main technical result needed for this proof 
is implication |^ ^ ^ of Theorem |^. This is proven in section ^. The construction of a UIOSS- 
Lyapunov function for an original system (^) is reduced, via a small gain argument, to the 
construction of a UOSS-Lyapunov function for a special system ( p^ related to the original 



system (g) . This reduction is done in section and section |3^ completes the construction of 
UIOSS-Lyapunov functions. 



Finally, implications |^ =^ ^, || =^ |2|, and ^ =^ ^ of Theorem |2| are proven in section O, and 
Q ^ ^ follows from Theorem [l|. 

3 Reduction to the case of no controls 

In this part we show how to reduce our main result to the particular case of systems with no 
controls. 



3.1 Robust output to state stability 

Definition 3.1 System (|5|) is said to be robustly output to state stable (ROSS) if there exists 
a locally Lipschitz /Coo-function (/?, called a stability margin, such that the system 

x{t) = g{x{t), d{t)) ■= f{x{t),du{tM\x{t)\)Mt)) (25) 
with disturbances d := [du,w] e Q := [-1, 1]'""+''""' and outputs y = h{x) is UOSS. 

Observe that the dynamics g of system ( p5|) are locally Lipschitz in x uniformly in d, and also 
g{0, d) =0 for ah d £ Q. 

Lemma 3.2 If a system @ is UIOSS, then it is ROSS. 
The proof will follow from a few preliminary lemmas. 

Let P E ICC and 71, 72 G /Coo be as in (^. Let a(r) = /3(r, 0). Without loss of generality, 
we may assume that a is /Cqo and a(r) > r (so that a^^i^r) < r). 

Define (p{r) to be a locally Lipschitz /Coo-function, which minorizes {r)) and can 

be extended as a Lipschitz function to a neighborhood of [0, 00). To prove the lemma we will 
show that ip is a stability margin for (^). 

Proposition 3.3 Fix a ^ G X, a control u, and a disturbance w, and let x(-) := x(-,^,u, w) 
be the corresponding solution of the system Let T E [0, tniax(?) u, w)). Then if |u(t)| < 
(/9(|x(t)|) for almost all t G [0, T], the estimate 

|x(t)| <max|/3(|e|,t), 72(||y|[o,t] ||), ^} (26) 

holds for all t e [0,r]. 
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Proof. 

Claim 1. Suppose T < tinax(?i u, w). If 

|u(t)| < (p{\x{t)\) for almost all t G [0,r), (27) 

then, for all t E [0,r), 

<max{a(|e|),272(||y|[o,t]||)}. (28) 

Proof of the Claim: Suppose first that ^ = 0. In this case x{t) = 0. Indeed, define d„ on 
[0,tmax(C,U, w)) by 

ro, ifx(t) = 

\ u(t)M|x(t)|) ifx(t)/0. 

Then (p7|) implies that G i]m„, and that x(-) is the solution of (p5|) with ^ = 0, w 

as we picked, and d„ as we defined. Noticing that the constant function equal to is also a 
solution of this system, with the same initial state and the same disturbance, we conclude by 
uniqueness of solutions that x{t) = for all nonnegative t, so that (28) trivially holds. 

Suppose now that 7^ 0. Fix e, such that 1 < e < 2. We will first show that, if |u(f)| < 
(/?(|x(t)|) for almost all t <T, then the estimate 

|x(t)| <max{eQ(|e|),272(||y|[o,t]||)} (29) 



holds for all t £ [0,T). Indeed, notice that ( |29| ) is true as a strict inequality at t = 0, because 
1^1 < a(l^l) < ea(kl)- If (H) fails at some t £ [0,T), then there exists a 



to = min{t<r : x(t) = max {eQ(|^|), 272(||y|[o,t] ||)}} . 

Note that to > because at t = we have a strict inequality in (p9|). So, ( |29| ) holds for all 
t G [0,to) and x{to) = max {eQ(|^|), 272(||y|[o,to] ||)}. Therefore for almost all t € [0,to) we have 

7i(||u|[o,t]||) < 7i(||v'(k(-)l)l[o,t]||) 

< max|^a"^(eQ(|^|)), ^a"^(272(||y|[o,t] ||)) 

< max|^ea(|^|),^272(||y|[o,t]| 

< max{a(|^|),72(||y|[o,t]||)} . 

Then, since our system is UIOSS and x(-) is continuous, for all t G [0, to] we have 

\x{t)\ < max{a(|^|),7i(||u|[o,t]||),72(||y|[o,t]||)} 
= max{a(|^|),72(||y|[o,t]||)} . 

On the other hand, |a;(to)| = ™ax {ea(|^|), 272(||y|[o,to]||)} by definition of to- The contradiction 
proves the estimate (29). Letting e tend to 1, we conclude that estimate ( p8[ ) holds for all 
t G [0,T), completing the proof of Claim 1. 

Hence, under the assumption of Claim 1, we have 

71 (||u|[o,t]||) < 71 (||v(k(-)l)l[o,t]||) 

< max{|,ia- (272 (11^1^11))} 
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for all t in [0, tmax)- So, 

<max|/3(|e|,t), 72 {\\y\[o,t]\\) , ^-j, ^a"' (272 (||y|[o,t] ||)) 
for all t £ [0, tmax)- Noticing that 

^a-^ (272 (||y|[o,t]||)) <72(||y|[o,i]|l)' 
(because a^^(r) < r) we arrive at (p6|). I 



Lemma 3.4 Given any /C£-function (3, there exists a /C£-function /? and a /Coo-function 1/ such 
that for any r > 0, any continuous function // : [0, r] ^ M>o, and any nonnegative constant C, 
the following implication holds: 

Vti, t2, < ti < t2 < T, fi{t2) < max t2 - h), c| (30) 

implies 

Mr)<max{/3(M0),r), i/(C)} . (31) 



Proof. By Proposition 7 in [39|, there exist ^1 and ^2 G ^00 such that 

/3(r,t) </ii(^2(r-)e~*), 

so, by majorizing /3 as above if necessary, we can assume without loss of generality that f3 is 
continuous in its second variable, and /3(r, 0) > r for all r. For any r > define to be the 
first time when P{r,Tr) = r/2. By replacing /? with the /C£-function /?, defined by 

p{r,t) :=max{/3(r,t), /3(r,0)e-*}, 

we can assume without loss of generality that the series X^^^q diverges for every r > 0. 
Define a function : M>o x R>o M>o as follows: 



4>{r,t) 



P{r,t) fortE[0,r,.) 

P{i.,t-E-Z^Tr) for te\E'=oTs,,EloTs^),k = 1,2,3.. 



Notice that the following two conditions hold for (p: 

1) For every R, e > there exists t > such that (j){r, t) < e for all r < i? and t > t. 

Indeed, fix positive R and e and find A; € Z such that l3{R/2^ , 0) < e. Next, by continuity of 
/3 and by compactness of [0, R\ we can find a t, such that X^to^ < * positive r < R. 

Then, if r < i? and t > t, then 



2) For all e > there exists 5 > such that if r < 5, then (j){r, t) < e for all t > 0. 
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Indeed, for all r and t, (j){r, t) < /5o(r) := (3{r, 0). For any positive e, take 5 = 5{e) := (3q ^(e). 
Then, for all t > we have 



< e. 



Therefore, by Lemma 2.12, (j) can be majorized by a /C£-function /?. 
Let z/(r) = P{2r,0). 

Now pick any /i, C and r satisfying (pC|). Define T = min{f : < 2C}, and T = r if 
H{t) > 2C for all t > 0. 

For any ti and t2 in [0,t] such that < ti < t2 < we have fj-{ti) > 2C, so that 
/i(ti)/2 > C, hence 

/i(t2) < max t2 - ti), /i(ti)/2} . (32) 

Suppose now that t = T. If < r < T^(o), then (|3^) with = 0, t2 = 7" yields 

^(r) < max|/3(^(0),r), ^1 = /3(M(0),r), 
where the equality follows from the definition of T)t{o) • Likewise, if 



r G 



■fc-i 



.4=0 4=0 / 



then 



Mr) < max|/3|^2-V(0),r-^r^^ ,2-('=+i)M0)| 
= /3('2-V(0),r-^T^y 



where the inequality follows from ( p2D and the equality is implied by the definition of T^(o) • 

2*^ 

Therefore we have 

Kr)<Hm,r). (33) 
In case t > T, inequality (^) implies 

h{t) < max|/3(2C,r-r),/x(r)/2,c| 

= max|/3(2C,r-r),C,c} </3(2C,0) = i/(C). (34) 

Combining (^) and ( |3^ we obtain 

^(r) < max{,/.(^(0),r),z.(C)} < max{/3(//(0),r),i^(C)} . 

■ 

Proof, (of Lemma |3.2|) We need to show that the system (^), corresponding to our system (pi) 



with the stability margin 99 we have defined, is UOSS. Apply Lemma |3.4| to the /C£-function 



P := (3 to find appropriate functions /3i G ICC and v £ K,. Assume given any initial state ^ and 
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disturbance d = [d„,w], and let x{t) := x(t,^,du,w) be the corresponding solution. Fix any 
positive t < tmax(?id), and define u by 



us 



ip{\x{s)\)du{s), s<t 
0, s>t. 



Then, for all s < t we have x{s) = a;(s, i^, u, w), where the latter is the solution of the original 
system with control u and disturbance w. Let C = 72(||y|[o,t] ||)- Then, for any ti and t2 in 
[0,t] we have C > 72(||y|[ti,t2] ||)- So, since |u(s)| < (/9(|a::(s)|) for all s G [0,t], Proposition 3^ 
will imply that 

|x(t2)| <max|/5(|x(ti)|,t2-ti), C 



By the choice of (3i and v we have then, 

\x{t)\ < max{/5i(|C| ,t),i/(72(||y|[o,t]||))} , 
proving the UOSS property for system (^ ) corresponding to the original UIOSS system. Thus, 



is indeed a stability margin for the original system, and the proof of Lemma 3.2 is now 
complete. I 



3.2 A UIOSS system admits a UIOSS-Lyapunov function 

We show now how the main implication of Theorem || follows from Theorem 



Lemma 3.5 (See Lemma 2.13 in ||4^) Suppose a system S of type (|5|) is ROSS. Let y be a 
UOSS-Lyapunov function for the system (p5|) associated with S. Then V is an UIOSS-Lyapunov 
function for S. 

Proof. Let (p he a stability margin for E. Since ^ is a UOSS-Lyapunov function for (p5|), 
inequalities (0) and ( |l9| ) hold with some ai, 02, as and 7. Pick a state ^ G X and disturbance 
value w £ T. For any control value u G U with |n| < V'dCI) we can find a du € [—1, 1]"^" such 
that u = duf{\(,\), so that by the dissipation inequality ( p^ for V (applied with d := [du,w]) 
we have 

vy(e) • /(e, u, w) = vvio ■ d) < -a^m) + jHhm, 

proving (^) for V. So, the condition as in Remark is satisfied for V with xi = y^^^^ and 
and 7 as before. Thus, F is a UIOSS-Lyapunov function for S. I 



By Theorem g, the system ( |25D admits a UOSS-Lyapunov function V. Hence the following 
corollary follows. 

Corollary 3.6 If a system (^) is ROSS, then it admits a UIOSS-Lyapunov function. □ 

By Lemma 3.2, every UIOSS system is also ROSS, hence the implication |^ ^ ^ of Theorem ^ 
follows. 
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3.3 UOSS and iiUOSS imply the GASMO property 
Lemma 3.7 A UOSS system of type (|^) satisfies the GASMO property. 



Proof. Assume that system ( p]7| ) is UOSS. Without loss of generality, we may assume that 72 in 
Equation ( |l^ ) is of class /Coo- 

Let T?(s) = P{s,0). Recall that we have assumed that 'd{s) > s for all s > 0. Now let p be 
any /Coo-function satisfying the inequality p{s) > 'i?(472(s)) for all s > 0. 

Claim: For any £ X, any d G M.fi and any r G [0, tmax(^> d)), if 

|x(t,e,d)| > p(|y(t,e,d)|) for ah < t < r, 

then 

72(|y(t,e,d)|) < |e|/2for anO<t<r, 

and hence 

|x(t,e,d)| < ,0) = m\) for an O < t < r. 
In particular, if \x{t, ^,d)| > p{\y{t, ^,d)\) for ah t € [0, tmax(C, d)), then tmax(^,d) = 00. 

Proof of the Claim: If ^ = 0, the result is clear. Pick any ^ 7^ 0, d G A4n and assume that 
\x{t,^,d)\ > p{\y{t,(,,d)\) for all < t < r for some r G (0, tmax(C,d)). Then, at t = 0, 

72(12/(0, e,d)|) < 72(p-^(|C|)) <72(p-^(^?(|e|))) < lel/4- 

Hence, 72(|?/(t, d)|) < |C| /4 for all t G [0,6) for some 5 > 0. Let 

ti=inf{i>0:72(|2/(t,e,d)|)>|C|/2}. 

Then ti > 0. Assume now that ti < t. Then 

72(|y(ti,e,d)|) = |e|/2, and 72(|y(t, e, d)|) < 1^1 A 

for each t G [0, ti), and hence for such t: \x{t,(,,d)\ < ■ Then, for each <t <ti, 

72(iy(t,e,d)i) < j2{p~\\x{t,td)\)) < j2{p'Hm\))) < \c\ /4- 

By continuity, 72(|y(ii, ^, d)|) < |^| /4, contradicting the definition of ti. This shows that it is 
impossible to have ti < r, and the proof of Claim is complete. 

For each r > let Tr be any nonnegative number so that P{r,t) < r/2 for all t >Tr. Now, 
given any r > and any e > 0, for each i = 1, 2, . . ., let rj := 2^~V, and let A;(e) be any positive 
integer so that 2-'=(^)r < e and define r^,^ as + + • • • + Tr^,^,) ■ 

Pick any trajectory x{t, d) as in the statement of Proposition 2.11, defined on an interval 
of the form [0,T], with T > T^^^, with initial condition |^| < r and disturbance d G A4n, 
satisfying |x(t,^,d)| > p(|y(t, ^, d)|) for all t G [0,T]. Then, the above claim implies that 
72(1^(^1 ^5 d)|) < 1^1 /2 for all such t. Therefore, for any t > T,.j = Tr, 

|x(t,e,d)| < max{/3(|e|,t), 1^1/2} 

< max{/3(r,t), r/2} < r/2. 

Consider now the restriction of the trajectory to the interval [T^j , T] . This is the same as the 
trajectory that starts from the state x(Tr^,^, d), which has norm less than ri, so by the same 
argument and the definition of we have that \x{t, (,,d)\ < r/4 for all t > T^^. Repeating on 
each interval [T^. ,Tr._^J, we conclude that \x{t,E,,d)\ < e for all T,.^£ <t<T. I 
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Lemma 3.8 Suppose a system of type ( [l7|) is iiUOSS and UO. Then it satisfies the GASMO 
property with p{-) := max |x~^(27(-))i Pi (")} ' where x and 7 are as in the definition of iiUOSS 
and pi is as in Proposition |2.16| . 

To prove this lemma, we need the foUowing elementary observation, which is a variant of what 
is usually referred to as "Barbalat's lemma": 

Proposition 3.9 Let X := {xa, ct £ A} be a family of absolutely continuous curves in X, each 
of which is defined on an interval la, either half-open (Tq = [0, Aq,)) or closed {la = [0, Aq,]). 
Suppose that 

• X is closed with respect to shifts, that is, for all a S ^ and T G la, there exists an a' S ^ 
such that where Xax is defined by Xaxii) •= Xa{t + T), and A^/ = Aq, — T. 

• There exists a nonnegative, increasing function 1/3, such that 

< i'3{\xa{t)\) y a £ A, for almost all t £Za 

• There exist funcions k and x of class /Cqo such that 

K{\xa{0)\)> [ x{\xa{s)\)ds ^ a £ A, t £ la- 
Jo 

Then for any two positive numbers r and e there exists a T^^e, such that for all a € „4 and 
t £ 2a the following holds: 

t > Tr^e and |xq,(0)| < r ^ \xa{t)\ < e. 

Proof. 

Claim 1: Given any e > 0, there exists S = S{e) such that if |xq,(0)| < 6, then |xQ,(t)| < e 
for all t £ la- 

Proof of Claim 1: Fix a positive e, and set 

die) = mm < -, k -— > . 

^' l2' \2v3{e))l 

Pick any a £ A such that |2;q(0)| < 5. 

Suppose |xa(t2)| > £ for some t2 £ la- Then there exist ti and t2 with ti < t2 < t2 such 
that \xa{ti)\ = e/2 and e/2 < \xa{t)\ < £ for all t £ (ti,t2). Then 

^ = \Xait2)\ - \Xaitl)\ < \Xa{t2) - Xa{tl)\ < SUp \Xa{t)\ {t2 - h) < J^3(e)(t2 " ^l)- 
^ tl<t<t2 

So, 

The obtained contradiction proves the claim. 

Claim 2: Given positive numbers r and 5, there exists a time r(r, 5) such that if |j;a(0)| < r 
and T(r, (5) GXo, then 3to < T(r, (5) such that |x(to,'^,d)| < 5- 
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Proof of Claim 2: Take r(r, (^) = Then, if r(r, (5) G Iq, and |xQ,(t)| > b for all 

t G [0, T(r, (^)), then we have 

<r) > K{\Xa{0)\) > / ^ ' ^ x{\Xa{s)\)ds > xW^S = '^W' 

The obtained contradiction proves the claim. 

Fix arbitrary positive r and e. By Claim 1, find 5{e) such that if |xa(0)| < 6{e) then 
< e for all t £ [0, A^). Define T^^^ := r(r, (5(e)), where r(r, 5(e)) is furnished by Claim 2. 
Then, if |2;q(0)| < r then, by Claim 2, there is a to < Tii^^^i^)) with |xa(to)| < K^)- Consider 
now a function Xa'{-) '■= Xa(to + •) (it belongs to X by assumption). Since \xa'\ < 5(£), Claim 
1 ensures that 

\Xa(t)\ = \Xa'it - to)\ <e y t>to> Tr^£. 

This show that Tr e satisfies the conclusion of the proposition. I 



We now return to the proof of Lemma 3.8 



Proof. Recall that we have defined A^^d := inf{t € [0, tmax(^> d)) : |x(t,^, d)| < p{\y{t,^,d)\)}, 
and let A^^d = ^max if \x{t,(,,d)\ > p{\y{t,(,,d)\) for all t £ [0,tmax)- Note that, given ^ and d, 
for all t < Ag^d we have x{\x{t,(,,d)\) > 2^{\h{x{t,(,,d))\) so that 

^(|ei)> f\x{\x{s,^,d)\)-j{\h{x{s,^,d))\))ds>^ fx{\x(s,C,d)\)ds. (35) 
Jo ^ Jo 

Let z/3 be a /C-function such that max^gj^ \ f(x^d)\ < z^ad^l). Write xg,d(") := x{-,(,,d). Notice 
that the family {x^^^i'), ^ G X, d G A4n} with T^^d '■= [0, A^^d) satisfies all the assumptions of 
Proposition |3.9| (with "k" = 2k). Given any positive r, e. Proposition |3.9| furnishes Tr^£. This 
Tr^s obviously fits the first condition in the characterization of the GASMO property, provided 
by Proposition 2.1L 



To find a function to ensure that the second part of Proposition 2.11 is satisfied, recall 
that, by Proposition 2.1£| , if a system (17) has the UO-property, then there exist class /Coo 
functions pi, pi, p2 and a constant c > such that the following implication holds for all 
^ G X, all d G Mn and ah T G [0, tmax(e, d)): 

\h{x{t,C,d))\<pi{\x{t,C,d)\) VtG [0,T] \x{t,^,d)\<pi{t)+p2m)+c VtG [0,r]. 

Therefore, if |^| < r and ,,/2 is as defined above, then for all t G [0, A^^d) we have 

\x{t,^,d)\ < pi{Tj.^^/2) + f^2{r) + c, iit<Tr^r/2 

and 

\x{t,^,d)\ <r/2, ift >T,,,/2. 
Thus, the following estimate holds for all such t: 

\x{t,^,d)\<m\) :=max{|e|/2, p,{T\^^^^^^/2) + P2m) + c} . 

Next, take a sequence {e^} , A; = 0, 1, 2..., strictly decreasing to 0, with eq = 1. For each 
Ek, find 6k = 5{ek) as in the proof of Claim 1. Since 6k < efc/2, the sequence {6k} coverges to 
as well. Find a function of class /C, such that: 
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1) >ek yk> 0. 

(this will ensure that |x(t,C,d)| < with|^| < \/t £ [0, A^,d]-) 

2) i?(s) > i?(s) Vs > 6o. 

Then satisfies the second condition in the Proposition 2.11. This completes the proof. 



Remark 3.10 The unboundedness observability assumption is crucial in proving the last 
lemma. The following example illustrates a disturbance-free iiOSS system which fails to be 
OSS (and, equivalently, fails to be GASMO). 

Let 1a(") denote the indicator function of a set A, and cf)^ be a C°°-bump function with 
support in (— e, e): 

( _ leP 

4>e{i)--={ ^ 1^1 <^ (36) 

I 0, \i\>e. 

Fix an arbitrary positive e < 0.25 and consider a one dimensional autonomous system 

S : X = /(x), y = h{x) 

where 

/(x) = x3[l(_^^_i](x)(l-<^,(x + l)) + l[i,+^)(x)(l-<^,(x-l))] - 
-X [l(_i,i)(x)(l - (/..(X + 1))(1 - Ct>e{x - 1))] , 

and his a, smooth function such that h{x) = x for all x in [—2,2], and h{x) = if \x\ > 3. 
Claim: The system S is iiOSS. 

Proof: Note that S has a stable equilibrium at x = and two unstable ones at 1 and — 1. 
If |x| < 1, then sign(x) = — sign(/(x)), so, if |^| < 1, then |x(t,^)| < 1 for any nonnegative t. 
Therefore, if ^ G [—1,1], then for all t > we have 

\x{s,0\ ds= f\h{x{s,m ds, (37) 



JO 

so, estimate ( p2[ ) trivially follows for all ^ G [—1, 1] and all t £ tmax(C) with ^ = Id and any 
K G /C. 

If 1^1 > 1 + e, then f{x) = x^, so that 



Thus, in this case the solution x{t,^) is defined for all nonnegative t < tmax(C) = and 

\x{s, ^)| ds = - < 



[ \x{s,0\ ds< [ 
Jo Jo 



Let K be any /C-function such that k(1) > (1 + e) ^. Suppose 1 < |^| < 1 + e. Let t be the 
time when \x{i,^)\ = 1 + e. Then tmax(6 = i + {1 + e)"^/2. Also, x(s,0 = Hx{s,0) for all 
s £ [0, i], so, in particular, equality (|37| ) holds for all i < t, which, again, trivially implies (p2|) 
with J = Id and any k £ fC. 
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If t > t, then 



t pt pt 

\x{s,^)\ds = / \x{s,^)\ds+ / \x{s,^)\ds 
Jo Jt 

t /'^max{^) 



< / |x(s,0|ds+ / \x{s,C)\ds 
Jo Jt 

ft /-tmaxCl+e) 

= / \h{x{s,£,))\ds+ I \x{s,l + e)\ds 

Jo Jo 

< ['\h{x{s,0)\ds + t,iO 
Jo 



< / \h{x{s,0)\ds + K{C). 







This shows that S is iiOSS, as estimate (22) holds for S with the k that we constructed and 
7 = M 

Claim 2. System S is not OSS. 

Indeed, pick any initial state ^ of large enough magnitude so that /i(^) = 0. Then h{x{t,(,)) = 
for all t < tmax(0 = If 5] were OSS, then there would exist some /C£-function /? such 

that < ,t), but \x{t,C)\ tends to cx) as t ^ imax(0> whereas (3{\C\ ,t) < (3{\^\ ,0). 

This contradiction proves the claim. □ 



We now prove implication ^ =^ |3| of Theorem 

Proof. Suppose a system S of type (0) is UOSS. We have already remarked that S is UO, so we 
must show it is iiUOSS. By assumption there exists a smooth function V satisfying ( p!9| ) and J?) 
with some ai, a2, as, and 7. Pick any d and t S [0, imaxl'?) d)). Integrating inequality (|l9) 
along the trajectory a;(-,^,d) over [0,t] we get 

' a3{\x{t,td)\)dt < V{x{0,^,d))-V{x{t,^,d))+ [\{\h{x{t,^,d))\)dt 

Jo 

< «2(iei)+ / 7mx{t,tdmdt, 

Jo 

proving inequality ( p^ ) for system S, with x = 03 and k = 02. I 

With Lemma |3.7| in mind we conclude that the only step missing in establishing the Lya- 
punov characterization for UOSS is proving the implication ^ =^ |^ in Theorem |2|. 



4 The case of no controls 



4.1 Setup 

Suppose a system S of type (|l7|) satisfies the GASMO property with some /Coo function p. As 
discussed in 2.6.1, p can be assumed to be smooth when restricted to M>o and also p{s) > s for 
all positive s. Recall the following notation, introduced in 2.6.1 : 

. P := {CGX: \C\<p{\h{m, 
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• £ := X\V, and 

. £,:={CeX: \C\>2p{\hm} . 

If P = X, then any proper, smooth and positive definite function 1/ : X — > M is a UOSS- 
Lyapunov function for (0). Indeed, because it is proper and finite, V obviously satisfies (0) for 
some ai and 02- Since V is smooth, |Vy(^)| is bounded above by a nondecreasing continuous 
function i^(|^|) and 

jV{x{t)) = VV{x{t))-f{x(t),d{t)) < i.{\x(t)\)us{\xm, 

where i^sd-]) is a /C-function majorizing f{-,v) for all v G Q. Then, since |x| < p{\h{x)\) for all 
X E X, we have 

< -K|x(t)|)z.3(|x(t)|) + 2u{p{\h{x(tmuMh{xm)) ■ 

So, V satisfies inequality 

VV{x)-f{x,d) < -a-iilxl) +-f{\h{x)\) Vx G X, VdG 

(with as{-) = i/(-)z/3(-) and 7(-) = [2u o p(-)][z^3 o p(-)]) which is the same as (^) for systems of 
type (0). 

Suppose now that D 7^ X. Recall that we have defined, for each ^ ^ T> and d G TWq, 
A^.d = inf {t G [0, tmax) : x{t, ^, d) G I?} , with the convention Ag^d = tmax(^, d) if the trajectory 
never enters P. 

The GASMO property then implies 

|x(i,e,d)| < A(|C|,t), V^Gf, VdGA^Q, Vt G [0,A5,d) (38) 

for some A G K,C. 

Note that, because of property (^), the system cannot have any equilibrium in £^ that is, 

/(e,^^)/o 

for every ^ £ £ and every d G 1^. Moreover, replacing p{s) by C/9(s) for some c > 1 if necessary, 
one may also assume that /(^, d) ^ for all ^ G \ {0}, all d G 0. 

We introduce an auxiliary system S which slows down the motions of the original one: 

' = = 1^1,, i|2^ , J i^^d) (39) 

1 + 1/(^,(^)1 +^(2) 

where k is any smooth function X — > [0, 00) with the property that 

k{0 > 2max|V(po|/i|)(e)-/(e,d)| (40) 

whenever |/i(^)| > 1. (Recall that p was assumed, without loss of generality, to be smooth for 
positive arguments.) For each disturbance d (defined on M>o) denote by 
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the value at time s of the solution of the equation z = f{z, d) with initial state ^. Observe 
that, as / is bounded, this solution exists for all nonnegative s. 

Claim 1 : For each ^ and each d, 

x(t,e,d) =z((J5,d(t),e,doCT^,d"^) Vt G [0,W(e,d)), (41) 
where cr^^d : [0, tmax('^, d)) M>o is defined by 



a5,d(t) = r [l + \f{x{s, d), d(s))|2 + d)) 



ds. 



Moreover, cr^^dif) ^ oo as t — > tmax(C)d), so, we can define crg,d(imax(C) d)) := +oo for conve- 
nience. 

Proof of Claim 1. Indeed, writing s = o"g,d(^) and computing the derivative of x[a^^^~^{s),S,, d) 
with respect to s, one has: 

/(x(t,e,d),d(t)) = la;(t,e,d) = ^x(a5,d"'ocTg,d(t),^,d) 

= ^a:(CT^,d~Hs),^,d) • ^CT^,d(i) 

= ^x(a5,d~'(s),e,d) [l + |/(x(t,^,d),d(t))|2 + K(x(t,e,d)) 



Therefore 



d , -1. w /(x(t,e,d),d(t)) 



ds-^^"^'" ^ l + |/(x(t,e,d),d(t))|V/^(x(t,e,d)) 

f{x{a^,A-\s),iA),doa^,A-\s)) 



1 + 1/ (x(^J5,d-H5), d), d o a^.d-H^)))!' + Kd-n^), d)) 

= ?{x (o-?,d~^(s),^,rf) ,docr5d"^(s)) , 

for all < s < cjg,d(^max(^, d)). Thus, the functions z(s, ^, d o cj^ d and x(cr^^d^^(s); ^, d) 
satisfy the same differential equation (|39| ) with initial state ^ on [0, o'^,d(*max(C) d))) , therefore 
they coincide on [0, o-g,d(imax('?, d))). 

To show the limit property of o"^,d) suppose 

lim o"5,d(i) = h < oo 

(note that the limit exists because o'^,d(") is increasing). Let 

K = {z{s,i,doa^^A-^) :0<s<6}. 

Then K is bounded, so K is compact, and by (pT[), x(t, ^, d) G C K for all t G [0, tmax('?) d)), 
contradicting the maximality of tmax(C)d). I 
For each initial state ^ and each disturbance function d, define 

05,d = inf{t >0: z(t,C,d) gP}, (42) 
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where O^^d = oo if z(t, (,,d) for all t > 0. Note that 0^^d > for all d e Mn and all ^ G <S, 
because £ is open. Observe also that if di = d o a^^d, 

%,d = '75,di(A5,di)- 

Claim 2: System S satisfies the GASMO property. 

Proof: According to (^8|) and (|4l|), we have, for every ^ & £ and each d, 

\z{t,^,d)\ = \x{a^^drHt),^,di)\ 

< xm,a^,dr\t))<m\), 

for all t G [0, where = A(s,0), and di = d 0(T^,d- Let 

Mr = l+ max |/(£,d)p+ max 

Then, for any € £ with |£| < r, it holds that 

= r [l + |/(x(s,£,di),di(s))|2 + K(x(s,e,di)) 



ds < Mrt 



for all t G [0,A^^di)) and hence, cr^^di ^(*) > ^g- for all |£| < r, t e [0,9^^d)- Consequently, we 
have 

\z{t,C,d)\<X{\C\,t) VtG[0,%d), (43) 
where A(s,t) = A(s, jgj) is clearly of class ICC. This shows that system S is GASMO. I 



From now on, we let the function A of class JCC be as in definition 2.9 for the system S, 
that is, the following estimate holds for system (^9|): 

\z{t,C,d)\<X{\^\,t) VtG[0,%d), (44) 

for all £ G f and all d G Mq. 

According to Proposition 7 in [EdI, there exist /Coo-functions fii and ^2 such that 



A(r,t) < /xi(/i2(r)e-*) Vr, t > 0. (45) 

Define 

E{s) :=fi^H^)- 

The proof will now develop as follows. We first construct a continuous Lyapunov-like func- 
tion Vo, defined on the set £1. Next Vq is approximated by a Lipschitz continuous function (by 
the methods of nonsmooth analysis). The resulting function is then approximated by a smooth 
function Vi. Finally we extend Vi to the rest of the state space, obtaining a Lyapunov-like 
function, smooth away from the origin, which is then approximated by a smooth Lyapunov 
function. 

Before we start, we prove a technical lemma. 

Lemma 4.1 Suppose S : i = f{z,d), y = h{z) is a system of type ([l7|), and p(-) is a smooth 
function of class /Coo; such that the following conditions hold: 
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• d)\<l for alU e X and den, 

• \V{po\h\){C) ■ f{^,d)\ < 1 for all den and all ^ with > 1, 

• p{s) > s for all s > 0. 

Pick any constant a > and define Kq = p(l) + (2 + a)/a + 1. Then for each ^ G X such that 



with the convention 9 = +oo if the inequality never holds for t>0. Assume the lemma is false, 
so that 9 <1. 

Let r] = z{9, ^, d), and let d be the shift of d by 9, that is d{t) = d{t + 9). Since \ f{z, d)\ < I 
for all 2; G X and all d e n, it holds that \r)\ > \^\ — 9 > Kq — 1. By the definitions of rj and 9, 
one has 



|e|>(l + aM|MOI)and \^\ > Kq 



it holds that 



z{t,C,d)\>p{\h{z{t,C,d))\) 



for all t e [0, 1) and any d G Ma- 



Proof. Fix a, ^ and d as in the formulation of the lemma, and define 



9:=mm{t : \z{t,^,d)\ < p{\h{z{t,^,d))\)} 




(46) 



Claim: h{z{s,7],d)) > 1 for all s G [—1, 0]. 



Assume the claim is false. Then there must exist some 



1 < So < so that 




We have that for each s G {sq, 0], \^h{z{s,r],d)) > 1. 

Recall that \V{po\h\){z)f{z,d)\ < 1 for all z with \h{z)\ 
Thus 



> 1 and all den. 




This, in turn, implies that 



p 



(|/i(2(so,?7,d))|) > p{\h{r])\) + so>Ko + so-l> p{l) 



and so, since p is strictly increasing, h{z{so,r], d)) > 1, thus contradicting the definition of sq. 
This proves the claim. 

It follows from the claim that \h{z{s,^,d))\ > 1 for all s G [0,^]. Thus, 



p{\hm 



> (1 + a)pi\hm -9>{1 + a)p{\h{7j)\) - (1 + a)9 - 9. 
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(The last inequality used the fact that |^p(|/i(2;(s, ^, d)|)| < 1 for all s e [0,6*]). It follows that 
< so from (HI) we know that 

Ko<l+p{\h{r,)\)<l+'^9, 

a 

contradicting the choice of Kq. This shows that it is impossible to have 9 < 1. I 



4.2 Definitions and basic facts on relaxed controls 

Recall that our disturbances d are measurable functions M>o — > = [—1, 1]™". 

Let V (n) be the set of all Radon probability measures on 0. Bishop's theorem furnishes 
a weak norm on 7^(0), whose corresponding metric topology coincides with the weak star 
topology on V (r2)(see [^], pages 40 and 267). 

For any T > 0, we define St to be the set of all measurable functions from [0,T] to V (O), 
and S to be the set of all measurable functions from M>o to V {^l). We topologize St by weak 
convergence: {ffc(-)} ^ ^(O St if and only if 

/ g{t,ij)d[iyk{t)]{uj)dt^ [ [ g{t,ij)d[iy{t)]{uj)dt 
Jn Jo Jn 

for all functions g : [0,T] x 17 ^ M which are continuous in lo, measurable in t and such that 

max a;)| , uj £ Q} 

is integrable on [0,T]. We say that {ffc} v weakly in S if, for every T > 0, the sequence 
{z^fc|[o_T]} of restrictions of z^^ to [0,T] converges to i^|[o.t] i^i St- 

Notice that, since every element of can be identified with the (5-measure, concentrated in 
it, can be embedded into V (fi), M.Q, into 5, and into St in the obvious way, where A^^ 
is the set of functions in TWq restricted to [0,T]. 

For each v (17), we denote 



f{x,v) = / f{x,r)di^ir). (47) 



n 

Notice that for any relaxed control the function /(•,zv(-)) : {x,t) f[x^u{t)) is Lipschitz 
in X and measurable in t. Moreover, as for all x S X and all v G V{^) we have a bound 

\f{x,v)\ < rnax|/(x,d)| , 

den 

the solution of the "system" x{t) = f{x{i),u{t)) exists for any initial condition ^ and relaxed 
control V on some maximal interval [0, tmax(C> '^))- Write x(-,^,z/) to denote this solution. Just 
as in the case with ordinary controls, we will define 

A^,;. := inf {t < t^ax : x{s, ^, u) £ V} . 
The basic three facts we will be using in the next section are as follows: 



Fact 1. For any T > 0, the space St is sequentially compact (See |5l|], Thm IV. 2.1, page 



272). Consequently, S is sequentially compact by a diagonalization argument. 
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Fact 2. For any T > 0, the set of ordinary controls on [0,T] is dense in St (see Q, 
page 691, also [Q). Consequently, A4fi is dense in S. The topology of S induces a topology 
on the subspace Mq- This topology is stronger than the topology of for any positive p: in 
fact, {dfc(t)} — > d would imply 

/ g{dk{t))dt^ [ g{d{t))dt 
Jo Jo 

for any continuous function 51 : U ^ M and any positive T. 

Fact 3. For any T > 0, the mapping {t, ^, 1-^ ^, i^) is continuous on [0, T] x Xx St 
(see [Q], Lemma 3.12). 

Some relevant immediate consequences of Facts 1,2, and 3 are as follows. 

Claim 1. The function X^^u is lower semicontinuous on both v and ^. (This easily 

follows from the continuous dependence on the initial conditions and control, and from the fact 
that the set V is closed). 

Claim 2. If system ([T7| ) is GASMO, then, for any initial value ^, a relaxed disturbance G 5, 
and time T < X^^y we have an estimate 

x{T,i,v)<Xm,T). 

Proof. Pick ^ G X and u & S. Let {d^} be a sequence of ordinary disturbances, converging to 
v in S. Then, for large enough k we have tmax(C)dfc) > T, and x(-,^, d^) converge to x{-,S^,v) 
uniformly on [0, T]. Also, by Claim 1, A^^dfe ^ Since we assume the system to be GASMO, 
the estimate (^) holds for d := d^ for all large enough k and for all t < T, so, the Claim 
follows. I 

With the previous claim in mind, we can say that the system (0) with d e S is GASMO 
(this is a slight abuse of terminology because, strictly speaking, (|l^) with relaxed disturbances 
is not really a "system", as that would mean, by definition, that disturbances take values in a 
finite dimensional space). Consequently, the auxiliary system (|39| ) is also GASMO for d G 5. 
Thus, we can assume that (44) holds for all G £ and all d G 5. 



4.3 Constructing a continuous Lyapunov-like function on Si 



In the section |4.1 we introduced the system T, : z = f(z, d) := — , — rr, which slows down 



the motions of the original system S. Recall also that 2? := : |^| < p{\h{S^)\)}, and define the 
set 

B := {C:p{\hm<\^\<^M\h{m- 



Let /o : X ^ M be defined by 



/o(0=max /(e,d) 
den 



Note that /g is locally Lipschitz, and recall that we have assumed with no loss of generality 
that S has no equilibria on the set {x G X : |x| > p{\h{x)\)} (otherwise replace p(-) by cp{-) 
where c > 1). In particular, /o(C) 7^ for any ^ G dV \ {0}. Let (/> : X \ {0} [0, 1] be smooth 
and 

1 xeV 

X eX\{V{jB). 



(j){x) 
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Now introduce another system, on the state space X \ {0}, 

S: z = f{z,d,v), 

where disturbances d are as before, and auxihary controls v are measurable functions of time, 
taking values in [—1, l]" (note that the dimension of the control set for t;'s is the same as that 
of X), where, for each i = 1, 2, ... n: 

fi{z,d,v) := fi{z,d) + 2(l){z)fo{z)vi. 



For each T > 0, let Wr denote the set of the auxiliary controls defined on [0, T] (i.e., 
measurable functions v : [0,T] — > [—1, 1]") equipped with the weak convergence topology; that 
is, "{vfc} converges weakly to v in Wt" means 

ip{s)vk{s)ds / 93(s)v(s) ds 
Jo 

for all functions ip that are integrable over [0,T]. With the weak topology, Wt is sequentially 
compact (c.f. p8| . Proposition 10.1.5]). Consequently, given any sequence {v^} of controls 
defined on [0, oo), there exist some control v and a subsequence {v^^. } such that ^ v weakly 
on every interval [0, T]. 

We denote the set of the auxiliary controls defined on [0, oo) by W. Let {v/^.} C W and 
V G yV. We say that {v^} weakly converges to v if, for every T > 0, the sequence of restrictions 
{vfc|[o,T]} weakly converges to v|[o^t] iii V^t- 

Recall that z{t,(^,d) denotes the solution of S. Write 2;(t,^,d, v) for the value at time t of 
the solution of S with initial state ^ / 0, disturbance d G Mn) and auxiliary control v G W. 

Observe that 



S is affine in v. 

Since for any ^ G X and d G [—1,1]™, f{S,,d) < 1, we have f{S,,d,v) 
and V. In particular, this implies that S is forward complete. 



< 3 for any ^, d 



• Suppose 6. ^ VU B and pick d G M.n and v G W. Then there is some to > such that 
z{t,^,d) ^VUB for all t G [0,to], and z(t,^,d,v) = z{t,^,d) on [0,to]- 

To extend the definition of z{t,^,d,v) to the case when d G 5, we let, for a fixed d G 5 
and V G yy, 

5d,v(^,t) ■.= f{z,d{t)) + 2^{z)fo{zMt), 

(where f{z, d{t)) is as defined in (|7|) for i/ := d{t) G V{n).) Then 5d,v : X \ {0} x M>o ^ X is 
locally Lipschitz in its first variable, and \gd,v{z,t)\ < 3 for all {z,t) G X \ {0} x M>o. Hence, 
the solution of 

z{0) = C 

exists for all ^ G X \ {0} and t >0. We will denote it by z{t, ^, d, v). 

Observe that / : X \ {0} x x [— 1, 1]" ^ M" is continuous, and f{z, d, v) is locally Lipschitz 
in z on X \ {0} uniformly on {d,v) G x [—1,1]". The system S evolves in the state space 
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X \ {0}. As / < 3 everywhere, trajectories are defined and unique for each initial value 
^ G X \ {0} and each pair of inputs d, v. Moreover, if z{-) is a maximal such trajectory, then 
either z{t) is defined for all i > 0, or there is some T > such that lim^^r ^it) = 0. We prove 
next that this last case cannot happen. 

Lemma 4.2 For every ball U around 0, there is a constant c such that for any G U , ^ 0, 
d £ S, V £ W, and t > 0, we have a lower bound 



(48) 



Proof. Since / is locally Lipschitz in x uniformly in d, and f{0,d) = for all d, we can find 



a positive constant c, such that 
|/o(-2)| < c|2;|/3; therefore 



f{z,d) < c\z\/3 for all z £ U and all d G ft. Then also 



fiz,d,v) < f{z,d) +2|/o(z)| <c|z 



for all V G [-1, 1]", ah d G O and, hence, ah d G Now fix ^ G t/ \ {0}, d G 5, and v G W, 

and write z{t) := z(t,^,d,v). Note that the inequality ( |48| ) holds for t = 0, therefore it holds 
for all small enough t > 0. Suppose that (|4^) fails at some t2 > 0, so that 



Then there exists a ti < t2 such that = |^| and \z{t)\ < |^| for all t G [ti,t2]- Let 

wit) := \zit)\' /2. 

Then, for almost all t G [^1,^2] 

\w{t)\ = \z{t) ■ z{t)\ <c\z{t)f = 2cw{t). 
In particular, this implies that w{t) + 2cw{t) > 0. So, for all t G [ti,i2] we have 

die^'^^wit)) 



(49) 



< e'^''\w{t) + 2cw{t)) 



dt 



implying that e^'^wit) > e^'^^witi) for ah t G [ti,t2]. Thus, 

^\z{t2)f=w{t2) > e'''^w{h)e-^''' = i|^(t,)|2e-2c(i.-iO > 1 |^|2 g-2ct.^ 



so that \z{t2)\ > e '^^^ |^|, contradicting (|9|). 



Corollary 4.3 For every r > and T > there is a a = a{r, T) > 0, such that for any d G 5, 
V G W, 1^1 > r and t <T we have 

|z(t,e,d,v)| >a. 

□ 
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Lemma 4.4 For each d G St and each v G Wt, if ■Ca: ^ ^ in X \ {0}, d^ ^ d in 5^, and 
Vfc ^ V in Wt, ^fe> djt, Vfc)} converges to z{t,(,,d,v) uniformly on [0, T]. 



< 3 and by 



Proof. Assume without loss of generality that G f/ := B\j\_{£^). Since 
Corollary gj, TZt (U) C -81,51^1+37.(0) \ -8^(0), where a = a{\i\ /2,T) is as in Corollary 
Let Ml and M2 be Lipschitz constants for f{-,d) (uniformly for d £ Q) and 2/o </> respectively 
on ^i.5|C|+3t(0) \-B<t(0). Write z{t) := 2(t,^,d,v), and 2^(0 := ^(i, dfc, v^). Now, for ah 
t G [0, r] we have 



|z(t) -Zfe(t)| 



ik-i+ {f{zk{t),dk{t),Mt)) - fiz{t)A{t)Mt)) ] dt 

t 



< \Ck-^\ + 

+ 

< \^k-C\ + 

+2 



/(z(t), dfc(t), Vfc(t)) - f{z{t),d{t)Mt)) dt 



f{zk{t),dk{t),Vk{t)) - /(z(i),dfc(t),Vfc(t)) dt 



fizit),dk{t))-fizit),dit)))dt 



ifo{z{t))cP{z{t))vkit) - Uz{t))cP{z{t)Mt)) dt 



(50) 
(51) 



+ / {Mi + M2)\zk{t) - z{t)\dt. 
Jo 



The integrals in ( ^0|) and ( ^T|) tend to because of the convergence of {dfc(-)} to d in 5 and 
the weak convergence of to v. So, for any e > we can find a K such that, for all k > K, 



16-^1 + 

+ 2 



fiz{t),dkit))-fizit),dit)))dt 



{foiz{t))<P{z{t))^rk{t) - fo{zitmz{t)Mt)) dt 



Then, for all > i^T and t G [0, T] we have, by Gronwall inequality, 

\z{t) - Zk{t)\ < ee-(^^i+^^)^ e(Mi+M2)t < ^ 
As e was arbitrary, this proves uniform convergence. I 

Also, since for any ^ G dD \ {0}, /o(0 / and /o(0 > /(^, d) for any d G we have the 
following controllability property on dD \ {0}: 

Lemma 4.5 Let ^ 7^ be on dX). Then, for each r > 0, there exists a neighborhood U of ^, 
such that for any tj £ U and any d G A4n, there is some control v, and some < ti < r, such 
that z{ti,rj, d, v) = ^ and z{t, rj, d, v) G C/ for all < t < ti. 

Proof. Since fo{0 ^-i^cl the function (/)(•) /o(") is continuous, we can find a ball f/i 
centered at ^ and a constant ci such that (/)(2;)/o(z) > ci for every z G Ui. Since (/>(^) = 1 and 
(j) is continuous, one could also find a ball U2 Ui centered at ^, so that 



fiz,d) < 1.50(z)/o(z), Vz G i72, d G 
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Fix r > and let B{^) he the ball of radius rci/2 centered at ^. Define U := B{^) nU2. Pick 
a point r) e U. Then |^ — r?| < tci/2, so, 

- 2(^-r?) 

i;2 := 

rci 

has norm smaller than 1. Consider the "feedback law" 

k{z,d) = ^{l.5h{z,d) + 0.5v2), 

where 

fiz,d) 



ki{z,d) := 



1.50(z)/o(z)' 

Notice that for all z G C/ and d G we have d)| < 1 and 

f{z,d,k{z,d)) = f{z,d) + 2(t>{z)fo{z)k{z,d) 

= f{z,d) + 1.54>{z)fo{z)ki{z,d)+0.5<P{z)fo{z)v2 
{i-ri)<t>{z)k{z) 



Q.h<t>{z)h{z)v2 



TCl 



Thus, with any initial condition rj £ U and disturbance d G Mn, if the control v{t) := 
k{z{t),d{t)) is applied, then the trajectory of the system S will be the line segment, connecting 
( and 77, transversed with a velocity greater than — vi)/t. So, there exists a to < r such that 
z{tQ, rf, d, v) = ^ and, since U is convex, 77, d, v) G for all t > to- ■ 

For each d G »S, let 

0d(e, v) = inf {i > : z{t, d, v) G P} , 
where as before, Od{^,v) = 00 if the trajectory never reaches V. 

Lemma 4.6 The map (^, v, d) 1— > Od{-, •) is lower semicontinuous on f x W x 5. 

Proof. Let {^fc} C {v^} c W and {d^} C 5 be such that ^ Ci^fc ^ v, and djt — > d for 
some ^ G V G W, and d G (S. We need to show that 

^d(^,v) <liminf0d,(6,Vfc). (52) 

Let Ok = ^dfc(Cfc) Vjt). Without loss of generality, we may assume that 

liminf 9}^ = 6q < 00. 

Passing to a subsequence if necessary, wc assume that 9^ ^ 9q. Thus, there exists some K such 
that 6*^ < 6*0 + 1 for all k > K. Since {z{t,^k,dk,\k)} converges to 2:(t,^, d,v) uniformly on 
[0,6*0 + 1], it follows that 

^(^o,C>d,v) = lim z{9k,^k,dk,-Vk)- 

fe— >c» 

Since V is closed and ^fe, d^, v^) G V for each k, we know that 2;(6'o, 4, d, v) G V, and 
hence, ^d(C)V) < ^q. ■ 
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Define, for ^ G d € cS and v G W, 

yv(e,d) := / H(|z(t,e,d,v)|)dt, 
Jo 

and, for ^ £ £ and d G 5, 

yo(e,d) := inf yv(e,d). 

vew 

Note that for some v and d, Vv(Cid) may take oo as its value, but Vo(C,d) is always finite, 
since 

VoiC,d)<Vo{^,d) (53) 

where O(-) is the control identically equal to 0. Recall that, by definition of H we have then, 
for all ^ £ £i and d £ S, 



Voitd) = / Ei\z{t,^,d,0)\)dt 
Jo 



ed(€,o) 

ed(«,o) poo 



E{\z{t,C,d)\)dt< / H(^i(/X2(|e|)e-'))<it<^2(|e|), (54) 
Jo 

where and fi2 are as in equation (^). 

Lemma 4.7 The function V(.-)(-, •) : iS x 5 x W ^ M>o is lower semicontinuous. 

Proof. Let (,^, d, v) £ £ x S x W, and let {^k} L {dk} d and {v/^} v, where (,k £ £ for 
ah A;. 

Case 1. Vv(^, d) < cxd. In this case, for any e > 0, there exists some < T < 0d(^) v) such that 

yv(e,d) = / H(|z(t,e,d,v)|)dt < / H(|z(t,e,d,v)|)dt + e. 

JO Jo 

Without loss of generality we can assume that all are within the unit distance from ^. Recall 
that the reachable set from the unit ball around ^ is bounded. Since 2;(t, ^fc, d^, v^) converges 
to z(t,^,d, v) uniformly on [0,T], and S(-) is uniformly continuous on compacts, there exists 
some X > such that 

|S(|z(t,e,d,v)|)-H(|z(t,a,dfe,Vfe)|)| < yk>K, yt£[0,T]. 

This implies that 



)\)dt-£ 



I H(|z(t,efc,dfc,Vfc)|)(it > f H(|z(t,e,d,v 
Jo Jo 

for all k > K. By Lemma 4.6, there exists some Ki > K such that 9Af.{^k-,^k) > T for all 
k>Ki. Thus, for all k>Ki, 

Vvf^iCk,dk) > / E{\z{t,^k,dk,Vk)\)dt 
Jo 

> [ E{\z{t,C,d,^r)\)dt-e > V^{^,d)-2e. 
Jo 
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As e was arbitrary, we conclude that 

yv(e,d) <liminfyv,(efc,dfc). 

Case 2. Vy,{(„d) = oo. 

In this case, ^d(C) v) = oo. Fix an integer k >0. There exists some such that 

Tk 

E{\z{t,C,d,v)\)dt > k. 





Repeating the same argument used above, one sees that 

E{\z{t,Ci,di,vi)\)dt >k-l 





for all / > Lq for some Lq. By Lemma 4.6, there is some Li > Lq such that ^d;(6) v;) > for 
all I > Li. Consequently, for all I > Li, 

K,te,dO> / ' E{\z{t,Ci,di,vi)\)dt>k-l. 
Jo 

Since A; > can be picked arbitrarily, it follows that 

liminf Vy^{Ci,di) = oo. 

In both cases, we have shown that liminf Vvi{S,i,di) > V^{S^,d). The lower semicontinuity 
property follows readily. I 

Lemma 4.8 For every ^ G d G 5, there exists a control v such that 

V^{^,d) = Vo{^,d). (55) 

Proof. Let be a sequence of controls such that Vv^. d) \ Vo{^, d). Without loss of generality 
we are assuming that all these controls are defined for all positive t (by letting them equal to 
where they are not defined). Extract from {v^} a subsequence {v^^} converging weakly to 



some limit v in W. Without relabeling, we assume that v. By Lemma 4.7 



yv(e,d) < lim K,(e,d) = Vb(C,d). 

fe— >oo 

Combining this with the fact that Vo{£,,d) < Vv{^,d) for all v G W, one proves (|55|). I 
Corollary 4.9 For any ^ G d G 5, v G W, and < T < 6'd(C, v), it holds that 

Vo(e,d) < ^Ei\z{s,td,^r)\)ds + Voiz{T,^,d,^r),dT), (56) 
Jo 

where drit) = d{t + T) for alH > 0. 
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Proof. Suppose the assertion is not true. Then there exist ^ G iS, T > 0, v G W, and d G 5 



such that (|5q ) fails. By Lemma 4^, one can find a control vi such that Vo(z(T, d, v), dy) = 
(z(r, ^, d, v), d-r). Define v to be the concatenation of v and vi. Then, letting 9 :- 
9dj,iz(T,^,d,v),\-i) and noticing that 0d(?) v) = 6 + T, we get, by our assumption, 

Voi^,d) > ^E{\z{s,C,d,^,)\)ds + %{z{T,^,d,^,),dT) 
Jo 

= I ~{\z{s,i,d,w)\)ds+ I H(|z(t,z(r,C,d,v),dT,vi)|)dt 
JO Jo 

H(|2;(s,^,d,v)|)(is, 





which contradicts with the minimality of Vb(^,d). I 

Lemma 4.10 For each ^ S &D, the following holds: 

limyo(r/,d) = 0, (57) 

uniformly in d E 5, that is, for any e > 0, there is a neighborhood U of such that Vb(r/, d) < e 
for all r? G [/ n all d G 5. 

Proof. If 1^ = 0, the result follows from ( p3| ) and (54) . Suppose now that ^ 7^ 0. 

Let e > be given. Let r = Find a neighborhood C/ of ^ as in Lemma 



Shrinking [/ if necessary, we assume that |^ — 7/| < 1 for all rj £ U. 

Suppose T] £ U n £ and d G M.n. By the controllability property, there is some control v 
such that z(ti,?7,d,v) = ^ G dV for some ti G [0,r], and that z(t, 77, d,v) G C/ for all t G [0,ti]. 
Thus, 

K(??,d) < / ' E{\z{s,r,,d,^,)\)ds < T ■ H(|e| + !)<£, 



Jo 

from which it follows that V()(ry, d) < e. 

The above shows that Vo(??, d) < e for all non-relaxed d G TWq, t] £ U D £ . Pick a relaxed 
d G 5. Then there exists a sequence {d^} C Mn such that d^ ^ d in the topology of relaxed 
controls. Let r] £ U H £. Let be such that Vo(r/,dfe) = Vv,^{rj,dk). By weak sequential 
compactness of W, one may assume, after taking a subsequence, that v^. ^ v for some v. By 



Lemma 4.7 



Vv(r?,d) < liminf yvfc(r?,dfc) < e, 

and consequently, Vo{r], d) < e. This shows that Vo(?7, d) < e for al\ r] £ U n£, all d £ S. I 
To prove the continuity of Vb, we also need the following result. 

Lemma 4.11 Suppose for some ^ £ £, d £ S, and v G W, Vv{(,,d) < 00. Then there exists 
some ^0 G dT> such that 

lim z(t,e,d,v) =^0- (58) 
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Proof. Suppose Vv{(,,i') < oo. This means that 



/ E{\z{s,^,u,v)\)ds<oo. (59) 

Jo 

If ^d(Ci v) < OO, then ( |5^ ) fohows from the continuity of v) with ,^0 = z{Od{£,,^))- 

Suppose now that 6d{S,,^) = 00. Since the integral in ( |59| ) converges, E{\z{s,£,,d,\-)\) ds 
decreases to as t tends to cxd. Consider the family of functions {xt{-), t > 0}, defined by 



Xt{s) := z(t + s, ^, d, v), It = [0,00). By Lemma O, the trajectory z(s,^,d,v) does not reach 
the origin in finite time, hence, there exists a positive, strictly decreasing function if such that 
ip{s) < \z{s,^,d,v)\ for all s > 0. Find a /Coo-function k such that 

poo poo 

Kiipit))> E{\z{s,td,^r)\)ds= Ei\xt{s)\) ds. 
Jt Jo 

Then the family {xt{-), t > 0} satisfies all the conditions of Proposition (with x ■= Take 
r := |.^|. Then, for any e > 0, |2;(t, ^, d, v)| < e for all t > T^^s- So, the conclusion of the lemma 
follows. I 



Proposition 4.12 The function Vq : x 5 — > M is continuous. 

Proof. Fix £ £, d £ S. Suppose — *■ ^) ^ d, where G Let {kj} be a subsequence of 
{k} such that 

lim Vb(Cfe,,dfc,) = liminf yo(4,dfc). (60) 

j—*oo k^oo 

For each k, let be such that Vo(Cfcidfc) = Vvf,{^k,dk). Notice that lim/j^oo ^'^.(■Cfc, d^) exists, 
because of (|60|). 

By sequential compactness of W, there exists a subsequence of {v^ } converging to some 



V G W. Without relabeling, we assume that v^^. — > v. It then follows from Lemma |4.7| that 



V^itd) < lim yv,/6,,d,..) = liminf Vo(6,dfc). 

Consequently, Vo(C,d) < liminf Vo(Cfc;dfc). To complete the proof, we will show that 

Vb(e,d) >limsupVb(Cfc,dfc). (61) 



Let V be a control such that Vo{(,, d) = Vv(^, d). Let e > be given. By Lemma 4.11, there 
is some ^0 £ dV such that ( |5^ ) holds. By Lemma [4.10 , there is a neighborhood C/ of .^0 such 
that 

Voiv, ly) < e/4 for ah ?? G [/ n f , aU G 5. (62) 

Let < T < 0d(^5v) be such that z(T, ^,d, v) G C/. Then, since {z(t, ^fc, d^, v)} converges 
to z(t,^,d,v) uniformly on [0,T], it follows that 2;(T, ^fc, d^, v) G U for A; > Ki for some 
Ki. By Lemma |4.6| , one may assume that T < 6'dj.(Cfc)V) for all k > Ki. Consequently, 
r] = z{T,^k,dk,'v) is also in £, so, applying (|62[) with = (dfc)^, we have 



VoiziT,Ck,dk,^r),{dk)T) <e/4, yk>Ki, 
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where {dk)T{t) = dk{T + t). Using the uniform convergence property of ^fc, d^, v)}, it 
follows that there is some compact set IC such that ^fc, dfc, v) G IC for all k, all t E [0, T]. 
Using also the uniform continuity of H(-) on compacts, one sees that there is some K2 > Ki 
such that ^ ^ 

[ E{\z{s,^k,dk,v)\)ds < [ E{\zis,C,d,v)\)ds + e/2 
Jo Jo 

for all k > K2. Thus, Equation (|56| ) implies 

VoiCk,d-k) < / E{\z{s,^k,dk,v)\)ds + Vo{z{T,S,k,fik,^),i(ik)T) 
Jo 

< V^{^,d)+e/2 + e/2 = Vo{^,d)+e 
for all k > From this it follows that 

Vo{^,d) > limsup Vo{£.k,dk) - e. 
Letting e — > 0, one proves (pi]). I 

For each ^ £ £, define 

VoiO ■■= sup Vo{^,d). (63) 



Note that the supremum is finite for each ^ G iS; in fact, by ( p3D and (|54|), we have the upper 
bound 

Vo{0<M\^\), vee^:, (64) 

where fi2 is as in inequality ( ^5|) . Also observe that the same function Vq results if the supremum 
in ( |63[ ) is taken over the set S. This follows from the fact that Ain is dense in S and the 
continuity property of Vq- 

By sequential compactness of S and by continuity of Vq, we get the following: 

Corollary 4.13 For any ^ in f there exists a (possibly relaxed) disturbance d such that Vo(^) = 
Vo(C,d), that is, Vo(C) = maXjjg^ Vo(C) d)- Moreover, Vq : f ^ M is continuous. 

Proof. Fix ^ £ £. By definition of Vq, there exists a sequence of disturbances {dfc(-)} such 
that Vo(C)dfc) y Vo(C)- By sequential compactness of 5, we can extract a subsequence {d^-}, 
converging in S to some d. By continuity of Vq, 

VoiO = lim Vb(e,dfcJ = Vb(e,d), 

J— >oo 

proving the first statement of the corollary. 

Now fix ^ £ £. Take any sequence {^k} £ £, converging to ^ and such that the sequence 
{Voi^k)} converges. Let dfc(-) and d G 5 be maximizing disturbances for and ^ respectively, 
that is, 

Voi^k) = Vo{Ck,dk) and Vo{0 = MC^d). 

Extracting a subsequence if necessary, let d be a limit of {d^} in S. Then, by continuity of Vq 
and by definition of Vq, we have 

^o(0 > = lim Vo{^k,dk) = lim Voi^k). 

fc— >00 K— >00 
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Consequently, if {^i} C £ is any sequence, converging to ^, then 

VoiO > limsupFote), 

proving upper-semicontinuity of Vq. 

On the other hand, again by continuity of Vq, we have 

liminfyo(efc) > hm Vo{^k,d) = Vo{C), 

fc^oo fc^oo 

showing the lower-semicontinuity of Vq. Thus we conclude that Vq is continuous on £. 



Lemma 4.14 There exists a /Coo-function a such that 



for all (e£i 



□ 



Notice that if \C\ > l.6p{\h{^)\) and C 7^ 0, then ^ G because \^\ > \C\ /1.6 > p{\h{C)\). 
Proof, (of Lemma [4.14| ) Recall that if ^ P U ;S, then /((^, d, v) = /(^, d) for any d and f , so 
that 

i.5\v{po\hm-fic,> 



v{i.5po\hm.f{^,d,v) 



i + \f{^,dr+Kio 



< 1, 



where the last inequality follows from ([40[). Therefore the assumptions of Lemma are 
satisfied with p := 1.5p and f{£,,d) := f{£,,d,v) = f{C,d). By Lemma [4.1| , we can find a 
constant Kq such that if |C| > Kq and |C| > l.Gp{\h{^)\), then z(t,^,d,v) ^ P U i3 for all 
t G [0, 1). In particular, for such a we will have 0d(C>v) > 1 and d, v)| > |^| — 1 for all 

positive t < 1 . Hence, the inequality 

H(|z(t,e,d,v)|)>H(|e|-l), VtG[0,l) 

holds for any d G v G W, and any such that 

ICI >max{ifo + l, 1.6/9(|/i(OI)}- (65) 
Therefore, for any ^ as in (|65|) and any d G A^rj, the following estimate holds : 

VoiO > m,d) > ['E{\z{t,^,d,^r)\)dt > E{\^\-1). 
Jo 



Next, notice that Vq is strictly positive on £. Indeed, 
V G [-1,1]'', so that 



< 3 for any ^ £ £ , d £ 0,, and 



idist(^,P) 



|z(s,e,d, v) - < -dist(e,P) V s < ^ - — d G A^n, V G W. 



Therefore Od{^,v) > idist(^,P) and \z{s,C,d,v)\ > ^ - ^dist{C,V) for ah s < idist(^,P), ah 
d G M.Q, and v G W. So, we have 



/.dist(C,X))/6 J- ./c p^ 

K(e,d) > / H(|z(s,e,d,v)|)ds > ^H(|^|-dist(C,P)/2). 

Jo 



6 
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This shows that 

Thus also the sup^g^vin ^^^vew Vv(^)d) satisfies (|66D, and hence the same inequahty holds for 

Since Vq is lower semicontinuous, it attains its minimum on any compact set. For each 
positive I define 

ri := J maxji^o + 1, 1.6/5(|/i(^)|)} and m; = inf {Vo(-2;) '■ z & £i, ri < \z\ < ri} . 

Since the sequence {mi} is non-increasing and positive, and H is of class /Coo can find a 
/Coo-function a such that 

a{s) <mi Vs G [n,n_i],V/ > 1 

and 

a{s) < E{s - l)Vs > max{Ko + 1, 1.6p{\h{^)\)} . 
By construction, a will be a lower bound for Vq on £i. I 



Combining Lemma 4.14 with (p^), we get the following, using a := ^2- 

am) <VoiC)< am, vee^i. (e?) 

The following lemma and corollary summarize the dissipation properties for Vq. 

Lemma 4.15 For any ^ G X \ (D U ;B) and d G Mn, and any to such that z{t, ^, d) ^ V U B 
for all t G [0, to]) the following dissipation inequality holds: 

to 



Vo{z{t,C,d))-Vo{0 < - [' E{\z{t,^,d)\)dt. 

Jo 



Proof. Fix ^gX\(DU;B), d £ Mq, and any positive to as in the formulation of the lemma. 
Let e > be given. Find di such that 

Vo{z{to,t d)) - Vo{z{to, e, d), di) < e, 

and let vi G W be a control such that Vo{z{to,(,,d),di) = Vvj^{z(to,^,d),di). Let d be defined 
by 

d(t) if < t < to, 

di(t-to) if t > to. 



d(t) 



Then z(t, 2;(to, ^, d), di, vi) = z(t + to, ^, d, v) for all t > 0. By assumption, 

z{t,^,d)^VuB VtG[0,to], 

therefore we have 

z{t,^,d) = z{t,^,d,^r) VtG[0,to], Vv G W. 



39 



Notice also that ( pSD implies that 0^{^,v) > for all v € W and 

r-e<,(?,v) 



Vb(C,d) = min 

vGW 

to 



to 



to 



to 



z(s,^,d, v) 



ds + min 

VGW 



ds 
'a(«,v) 



■Mz(s,^,d)\)ds + min 



to 

ed^(2(to,C,d),v) 



^(|z(s,z(to,^,d),di, v)|)(is 



H(|z(s,e,d)|)ds + Fo(^(to,e,d),di). 
Consequently, one has 

Vo{z{to,C,d),di) = VoiC,d)- 

Thus, 



to 



i\z{s,C,d)\) ds. 



Vo{z{to,^,d)) < Vo{z{to,^,d),d,) + e 

'■to 



Vo{^,d) 



■{\z{s,^,d)\)ds + £ 



< VoiO- /"s(|z(s,e,d)|)ds + e. 
Jo 

Letting e ^ 0, we get the desired inequality. I 

Thus, we have proven that the UOSS dissipation inequality holds for Vq along the trajectories 
of the slower system S which are entirely contained in X \ (D U ^B). It follows immediately that 
the same estimate holds along the trajectories of the original system S: 

Corollary 4.16 For any ^ £ X\ {V U B) and d G Mn, and any to such that x{t, (,,d) ^VUB 
for all t £ [0, to]i the following dissipation inequality holds: 

Vo{x{t,^,d))-Vo{0<- rE{\x{t,^,d)\)dt. (69) 

Jo 

Proof. Pick an initial state ^ G X\(DUi3), a disturbance d G Mn, and an appropriate to- Then 

Vo{x{to,^,d))-Vo{x{0) 
= Vb(2;(cjg,d(to), d o a^A^^)) - Vo{z{a^^d{ti),^, d o cr^.d"^)) 

/■o"5.d(*o) 

< - / Ei\z{s,C,doa^^d-')\)ds 
Jo 

= - [' E{\z{a^,d{t),tdoa^^d-^)\)da^^dit) 
Jo 



to 



to 



■{\x{t,C,d)\)-a^^d{t)dt 

^, d)|) [1 + ^, d), d(t))|2 + K{xis, t d))] (it 



< 



to 



H(|x(t,e,d)i)dt. 
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4.4 Some definitions and facts from nonsmooth analysis 



Definition 4.17 A vector (" G W" is a proximal subgradient (respectively, proximal supergradi- 
ent) of the function V : M" — > (—00, +00] at x, if tliere exists some positive a such that, for all 
x' in some neighborhood of x, 

V{x) > V{x) + C-{x' -x)- a\x' - (70) 

2 

(correspondingly, V{x') < V{x) + ( ■ {x — x) + a\x' — x\ ). (71) 

The (possibly empty) set of all proximal subgradients (respectively, supergradients) of V 
at X is called the proximal subdijferential and is denoted dpV{x) (respectively, proximal su- 
perdifferential, denoted d^V{x)). Note that the definitions imply that if the function V is 
differentiable at x, then both the subdifferential and superdifferential sets must be subsets of 
the {VV{x)}. □ 



Lemma 4.18 Let S be a system of type (|T7|), ^ be a vector in X, J G $7 and 1/ : X ^ M. Then, 
if there exist some continuous : M>o M and e > such that the following inequality holds 
for all T < e: 

V{x{T,^,d))-V{0 < r a^{t)dt (72) 



(where d is the constant disturbance equal to d), then for any C, G dpV{S^) the proximal form 
of inequality ( [7^ ) holds: 

C-f{iJ)<o^m- (73) 
Proof. It follows from (^) and ( [72[ ) that, for all r close enough to we have 

r a^{t)dt > V{x{T,C,d))-V{0 > C-{x{r,C,d)-0-c7\x{T,^,d)-^\\ 
Jo 



Dividing by r and passing to the limit as r tends to 0, we get (73). 



4.5 Smoothing out a continuous Lyapunov function 

The next result shows how to approximate a continuous function y by a locally Lipschitz one 
in a weak sense. The function V is assumed to be bounded below, or up to a translation by 
a constant, nonnegative. 

Lemma 4.19 Let T, : x = f{x, d) be a system, with x G X = M", and d G 0, a compact metric 
space, so that f{x,d) is locally Lipschitz in x uniformly on d and jointly continuous in x and 
d. Assume that we are given: 

• an open subset O of X; 

• a continuous, nonnegative function i/ : O — > M satisfying 

C • fix, d) < e(x, d) Vx G O, C e dpV{x), deQ (74) 
with some continuous function : O x ^ M; 
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• two positive, continuous functions Ti and T2 on O. 

Then there exists a function V : O ^ M, locally Lipschitz on O, such that 

< V{x) - V{x) < Ti(x) Vx G O, (75) 

and 

LfaV{x) < e{x, d) + T2(x) for all d e Q and almost all x E O, (76) 
where fd is the vector field defined hy fd = f{-,d). □ 

Note that, by Rademacher's theorem, the directional derivative Lf^V{x) = W{x) ■ f{x,d) 
is defined for almost all x, because V is locally Lipschitz. The proof will follow closely along 
the lines of the proof of the similar result for CLF's, found in |p or |]3^ . 

We will first prove a "local" version of the result. For any K which is a compact subset of 
O and r > 0, we introduce the following notations: 

• Br{K) := {x e X : 3^ G with |x — ^| < r} - the closed r-fattening of K, for r > 0. 

• (5{K) := sup^g^y(x), 

• tuk '■= \ min 1X2(3;) : x G K} , 

• ix '■= 8k Lipschitz constant for / with respect to x in K, that is: 

\f{x,d) - f{x',d)\ <eK\x-x'\, yd en, ^xeK, 

• LOxi') ■— the modulus of continuity of y on A', that is: 

coKi^) '■= sup {V{x) — V{x') : \x — x'\ < 6; x, x' G , 

• t^k{') ■= the modulus of continuity oi Q on K x Q, that is: 

7Tk{S) ■■= sup {9(2;, d) - G{x', d') : \x - x'\ + dist {d, d') < 6; x, x' G K, d, d' £ Q.} . 

To approximate the given continuous function V hy a, locally Lipschitz one, we would like 
to use the notion of "losida-Moreau inf-convolution" , well known in convex analysis. Fix a 
parameter a G (0, 1]. Suppose for the moment that V is defined on the whole X. Define 



Va{x) := min 



For each fixed x, the set of points y where the minimum is attained is nonempty, because V is 
bounded below. Denote one of them by ya{x)- 

Fix a compact K and a G (0, 1], let 

The following four claims summarize some of the useful properties of V^, proven in [^] (or 
see the primary sources such as 0]): 
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Claim 1: For all x G 

\ya{x) — x\'^ < mm ^2a^ P{K), la^LVK^i [ct 

Proof of Claim 1: By definition of Va and P{K), we have 

^ \ya{x) - < V{x) - V{ya{x)) < V{x) < p{K), (77) 

so that \ya{x) — xl"^ < 2a^l5{K). On the other hand, the first inequality in (^) implies also 
that 

\ya{x)-x\' < 2a^{V{x)-V{yo^{x))) 

< 2a^ujK^ i\yaix) - x\) < 2a^ujKo. {a 



proving the claim. 
Let 



Claim 2: For any x G X, 



A / \ X ya{x) 

^a\X) — 5 • 



a" 



Ca{x)CidpV{yc,{x)), and (78) 
Ux) G a^K.(x), (79) 

Claim 3: For any x G K, 

Vaix) < V{x) < Va{x)+u;K^ (a^JWiK)) . 
Claim 4: Va is locally Lipschitz. 

Now recall that, in our setting, V is defined on an open subset O of X, so, we can't minimize 
the expression in the definition of Vq, over the whole state space. However, for any compact 
subset ivT of O we can choose a small enough so that 



hence, for any x in X we could define Va minimizing over y £ O, and the same function Va 
results on K. 



Lemma 4.20 Assume that V satisfies (74), a compact K is fixed, and a G (0, 1] is chosen to 
satisfy 

• Ka = B^,/:^,{K)cO, 



TTKc, [a\/2(3{K)) < rriK, and 



2eK^iOK^ [aJ2/3(K)] <mK. 



43 



Then the function 



Va(x) := inf 



(80) 



will possess the following property: 

for all X e K, all d e O, and all ( G dpVa{x), 



C • f{x,d) < e{x,d) + 2mK. 

Proof. Fix any x £ K. The choice of a insures that the infimum in (^0[) is a minimum, and it 
is achieved at some ya{x) S Ka- The definition of Ca{x) and Claim 1 imply that 



\Ux)\\Va{x) - x\ = '^"^"^^^ < 2u:k^ (a^JWiK) 



(81) 



Using again the fact that Uaix) G K^, 

\f{x,d) - f{ya{x),d)\ < £kJx - ya{x)\. 
Combining the last inequality with (^) we obtain 

\Ca{x)\\f{x,d)-f{ya{x),d)\ < 2iK^ojK^ [a./2P{K)) . 

Now, by Claim 2, Ca{x) G dpV{ya{x)). Hence, 

Ca{x) ■ f{ya{x),d) < @{ya{x),d) 

< Q{x,d) + TTK^ilx - ya{x)\) 

< e{x,d)+7TK^ (aV2/5(i^)) 

< Q{x, d) + TTlK- 

So, by the last inequality, (^2|), and the choice of a, we have 

Ca{x)-f{x,d) = Ca{x) ■ f{ya{x),d) +Ca{x) ■ {f{x,d) - f{ya{x),d)) 
< Q{x,d) + rriK + rriK- 



(82) 



(83) 



Next, we show that dpVa{x) C {Ca} for all x £ K. Pick any ( £ dpVa{x). By definition of 
the proximal subgradient, the inequality 

C-iy-x)< V^{y) - VUx) + o{\y - x\) (84) 

holds for all y near x. Since Caix) is a proximal supergradient of Va at x, we also have 

- Ca{x) ■{y-x)< -Vo,{y) + y„(x) + o{\y - x\) (85) 

Adding (|4|) and (H), we get 

{Q-Ux))-{y-x)<o{\y-x\) (86) 



for all y sufficiently close to x. Substituting y = x + h{C, — C,a{x)) in (86) and letting h tend to 
0, we arrive at C = C,a{x)- ■ 



44 



Now we are ready to prove the main lemma of the section. 

Proof, (of Lemma 4.19| ) For every x & O find an r^^ > smah enough so that Br^{x) C O. Then 
the collection of open balls {Br^{x), x £ O} forms an open covering of O. By paracompactness 
of O we can find a locally finite refinement {Bi,i G N} of {Br^{x), x G O} (c.f. Lemma 4.1]). 
Moreover, since Ux^oBr^ = O, we also have UiBi = O. Let {</?i,i G N} be a partition of unity, 
subordinate to {Bi\. For each index z, let 

= {i G N : Bi n Bj / 0} . 

Notice that Ji is finite for all i, because of local finiteness of the covering {Bi\. For every z G N 
define 

Mi :=sup|V(^,(x)||/(x,d)|, 
where the supremum is taken over all x G Uj(=j.Bj and all d € i}; and 

Ni = max card (J'j), 

that is Ni denotes the maximum cardinality of J^j for j such that Bj intersects Bi. Next, for 
each compact K = Bi, i £ 'N choose an ai as in the formulation of Lemma 4.2C , satisfying the 
following two additional conditions: 

NiCOK^^ (ai^mA)\ Mi<l inf T2(x) (87) 

and 



UK^^ (a,^2P{BM < \ inf Ti(x). 

(where K^^ denotes B^^^^^^{Bi) ). 

Next, for each i G N, define VJ^. on Bi as in (|80| ) (this can be done, because, by the 
choice of Oj, K^- CO). Since V^- is locally Lipschitz, it is differentiable almost everywhere by 
Rademacher's theorem. Lemma 4.20| implies that for almost all x £ Bi and all d G 

Lf^V^^ix) <Q{x,d) + T2{x)/2. 



Define 

V ■.= Y,yo..^^■ 

1=1 

Strictly speaking, this does not make sense, because Vq,. is not defined outside Bi, but that does 
not matter, because (pi vanishes outside Bi anyway. 

Since each Va^ix) < V{x) for all x £ Bi and (^j's add up to 1, the definition of V shows that 
V{x) < V{x) for all x G O. It is also clear from the definition of V that V is locally Lipschitz 
on O. 

We claim that for almost all x G O and all d G O the following holds: 

1. < V{x)-V{x) < Ti(x); 

2. VV{x) • f{x, d) < e{x, d) + T2(x). 
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Take any x £ O and find i G N such that x G Bi. Define also J'x := {j £ : x £ Bj}. 
Note that ^ and that V{x) := ^jgj^ Vaj{x)ipj{x). Then Claim 3 and the choice of aj 
(condition (|88|)) imply 



V{x) - V^^ix) < LOK^^ (^aj^2(3{B,)^ < T,{x)/2 



for all j £ J'x- Thus, 



+CX3 

V{x)-V{x) = V{x)-J2Vc.,^J 
= Vix)-^V^^ipj 



< V{x) - min {V«^ (x)} j ^ ipj{x) 



< 



V{x) - min {Vaj{x)] 
Ti(x) 



proving the first statement. 

To prove the second statement, write 



Lf,V^^{x) vj{x) + ^ L^,<^,-(x) - Lf.'Pjix) (89) 



max 



< maxL/^K.j(x) Y '^i(^) + (^«.(^) ~ ^(^)) ^fdfji^) 
'^^^ je:^. je^. 

< G(x,d) + T2(x)/2+ J] |y,^.(x)-y(x)| |L;,VPj(x)| 



< G(x, d) + T2(x)/2 + Mj^K^, (90) 

< e(x,d) + T2(x)/2+^^ (91) 



< e(a;,d) + T2(x)/2 + T2(a;)/2 (92) 

< e(x,d) + T2(x) 

where the equality ( p9| ) follows from the fact that X^jgj-^ ^fd'fij(^) ~ inequality ( pO] ) follows 
from Lemma 4.2Cl| , and Claim 3; inequality (91) follows from the choice of ai (condition (^)); 



and (92) is implied by the fact that 

cardj;, < Nj Vj £ Ji. 
This completes the proof of the lemma. 
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The lemma we have just proved will provide the "continuous locally Lipschitz away from 
zero" step in the smoothing process. To obtain a smooth Lyapunov function, we will use the 
following simple smoothing result. The proof is given, for the special case when a does not 
depend on d, in [^], but the general case (q depends on d) is proved in exactly the same 
manner, so we omit the proof here. 

Lemma 4.21 Let O be an open subset of M", and let J7 be a compact subset of M', and assume 
given: 



a locally Lipschitz function $ : O 

a continuous map / : R" x 17 ^ 
uniformly on d; 



\ (x, d) 1— > /(x, d) which is locally Lipschitz on x 



• a continuous function a : O x — > M and continuous functions [i, v : O ^ M>o 
such that for each d £ 

Lf^^O<a{^,d), a.e. eeO, (93) 

where fd is the vector field defined by fd = /(•, d) (recall that V<l> is defined a.e., since <I> is 
locally Lipschitz by Rademacher's Theorem). Then there exists a smooth function ^' : O ^ M 
such that 

1^(0-^(01 < Me), veeo 

and for each d G 17, 

□ 



The next result immediately follows by Lemma 4.21 



Corollary 4.22 Under the assumptions of Lemma 4.19 there also exists a smooth function V 
on O, satisfying inequalities 



and 



V{x)-Vix) < Ti(x) Vx e O 
LfaV{x) < G(x, d) + T2(x) for all d € 17 and all x e O. 



(94) 
(95) 



Proof. Suppose that O, V, Ti, and T2 are given and the assumptions of Lemma |4.19| hold 



Replacing Ti by Ti/2 and T2 by T2/2, and applying Lemma 4.19 , we can find a locally 



Lipschitz function V, defined on O and satisfying (75) and (95) with Ti/2 and T2/2 instead 



of Ti and T2. Next, Lemma 4.21 , applied with the same O and with ^ := V , a := Q + T2/2, 
fi := Ti/2, and v := T2/4 furnishes a smooth function V := ^ as needed. I 



In section 12 we have constructed a function Vo, satisfying inequalities (67) on £"1 and (^ 



along all trajectories of S, contained in £1. Therefore, by Lemma 4.18, the proximal inequal- 
ity (|7^ ) holds for Vq at any interior point of £1. Then Corollary 4.22 , applied with O := int £1, 
'^li') '■= a(|-|)/2, T2(-) := H(|-|)/2, 0(x, d) := H(|x|), provides a smooth function 



Vi : int £1 



Vi := Vo 
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satisfying the following two conditions for all ^ G int £i: 

a(|ei)/2<T4(e)<a(|^|)+a(|e|)/2 

(we will replace a(|-|)/2 by a{-) and a{\-\) + a{\-\)/2 by a{\-\) from now on to avoid cluttering 
the notation.) 

Lf^Vi{0<-Eim VdGO, (96) 

where Hi(-) = H(-)/2. 

4.6 Extending to the rest of X and smoothing at the origin 

To construct a UOSS-Lyapunov-like function defined on the whole X, we must "patch" Vi with 
some smooth, proper, and positive definite function such that the dissipation inequality still 
holds. 



Lemma 4.23 Suppose S is a system of type (p^), and p is a function of class /Coo- Define £i := 
{x £ X : \x\ > 2p{\h{x)\)} and suppose that Vi : £i ^ M>o is a smooth function satisfying, 
with some suitable /Coo functions, the inequality 

a(|^|)<yi(0<a(|el) (97) 

and inequality ( |96|) on £i. Then there exist a Lyapunov-like function V2 for S, smooth away 
from the origin, and a class /Coo function <I>, such that 

V2{x) = ^ o Vi{x) Vx such that > 3/9(|/i(x)|), 

and the following dissipation inequality holds with some 03 G /Coo, 7 S /C 

vy2(0-/(C,rf)<-«3(iei)+7(IM6l) wen. (98) 

Proof. Let 

£2 := : \^\ > Sp{\h{m 

Since the sets : > 3/9(|/i(^)|)} and : |^| < 2p{\h{S^)\)} are disjoint and closed in the 
topology of X \ {0}, one can find a smooth function : X \ {0} [0, 1] with the property that 



1, if\^\>3p{\hm 
0, if iei<2/,(|/i(oi) 



and (j) is non-zero elsewhere. It is easy to see that |V0(2;)| is bounded above by a /C function 1^2 
of \x\ outside the unit ball centered at 0. One can also find a smooth, strictly increasing function 
ui : [0, 1] M>o, such that ui{0) = and \V(f){x)\ < — ^ for all x such that < |x| < 1. 

Let 1/3 be a /C-function such that max^g^ |/(^, (i)| < z^sd^l). Take any smooth function 
TTi: [0,a(l)] R>o with 7r'i(s) > for all s e (0,a(l)), such that 

7ri(a(r)) , . 7ri(r^) 

< s{r), — -— < s{r) 

for some /C-function s and all < r < 1. Let 112 be any /C-function such that 7r2(r) < '/r^(r) for 
all nonnegative r < 1. 
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Let $(r) = 7r2(ri)(iri. Then $(r) < 7ri(r) for all r < 1, so that l"^^^ < s{r) and 

|^<s(r)for ah re (0,1]. 
Now let 

V2{0 = mHViiO) + (1 - -/-(O)^!!^!')- (99) 
If 1^1 > 3p(|/i(^)|), then V2 = ° in a neighborhood of ^, so that, for all (i G fi, 

VV2iO ■ f{^,d) = $'(Vi(0)[Vyi(e) • fiCd)] < -vr2(a(|C|))Hi(|e|). (100) 
On the other hand, if \C\ < 3p{\h{C)\), then 
VV2iO-fiC,d) 

= ■ fitd)] ^viio) + m ^'(^i(0) [vi4(o • fitd)] 
-Nm • /(e, ^^)] mf) + (i - -^(e)) 2a>'(iei') [e • /(e, d)] 

< iv0(e)ii/(c,(i)i Hv^io) + \vm\\fitd)\ m\') + 2\ii-m)\ ^'m') ieii/(c,d)i 

< \vm\\fic,d)\ Haim + \mo\\fic,d)\ m\') + '^'^'m') ieii/(e,d)i, 

where the first inequality follows from the fact that $'(Vi(C)) [VVi(^) • f{£,,d)] < 0. Next, 
the definition of <I> provides the following bounds for the three terms in the right-hand side of 
the last inequality: 

^(«(l4l))|V0(e)||/(C,d)| <max{.(|^|),<I>(a(|C|))z.2(|C|)}i^3(|e|), 

2<^'(ici')[e-/(e,ci)]<2vr2(iei')ici^3(iei), 
^(iei')iv0(oii/(e,d)i <max{.(ici),ci>(ici>2(iei)}^3(iei). 

Define as, 7, di and 02 by 

asir) := vr2(a(r))Hi(r), 



7(r) := 27r2((3p(r))2)3p(r)i.3(3p(r-)) 

+ max {s(3p(r)), $((3p(r))2)z.2(3p(r))} z.3(3p(r)) + d3(3p(r)), 

di(r) = min |<I>(r^), $ o a(r)} , 

and 

Q^2('^) = max |<I>(r^), <I> o Q(r)} . 

Then inequalities 

di(kl) < "1^2(2;) < d2(k|) Vx/0 (101) 

and (^) hold for V2. Define ^2(0) := 0. Then inequality (Q) holds for V2 with ai := di, 
«2 := d2 on X, and in particular implies that V2 is continuous as 0. Then, V2 is a UOSS 
Lyapunov-like function for S, smooth away from the origin. I 

Recall that V2(6 = ^(^i(0) for all ^ with |^| > 3p(|/i(OI)- Therefore inequality (||) implies 
that 

VV2 • /(C.'i) < -asdel) for all |^| > 3p{\h{^)\), and all d G 0. (102) 
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Proposition 4.24 Suppose that a system S of type ( [T7| ) admits a continuous UOSS Lyapunov- 
like function V2, smooth away from and satisfying inequalities ( |101| ), (p^), and ( |102D . Then 
T, admits a UOSS-Lyapunov function. □ 

The basic idea used to obtain a Lyapunov function, smooth on the whole X, is composing V2 
with some appropriately chosen /Coo-function /?. This technique was previously utilized in |26|. 
We will need the following generalization of Lemma 4.3 from [^], where this function /3 is 
constructed. In our setting we also need the derivative of /5 to be of class /Coo, which was not 
required in The proof is only a slight modification of the proof of the mentioned lemma. 

Lemma 4.25 Assume that V : M" — > M>o is C", positive definite, and the restriction V^|ik"\{o} 
is C°°. 

Then, given any m £ N there exists a /Coo-function /J.^, smooth on (0,oo), satisfying the 
following conditions: 

• l3m{t)^0 as t^0+ for each i = 0, 1, . . ., 

• (3m G /Coo Vi < m, 

• Wm:=l3oV is aC°° function on all of W. 

□ 

We now return to the proof of Proposition [4.24 . 

Proof. Take the function V2, and apply Lemma 4.25 to get a function (3i, with derivative in 
class /C, such that 

^3 := Pi o V2 

is smooth on X = {0} in our case). Let ai(-) := /9i(ai(-)/2), a2{-) ■= /3i(a2(') +Q;i(-)/2). 
Then Oi £ /Coo and, 

ai{\x\) <V3{x) <a2{\x\). 
Furthermore, for any x G X \ {0} we have 

Lf^Vsix) = P[{V2ix))[Lf^V2]{x) 

< (3[{V2{x)){-a,{\x\)/2 + j{\h{x)\)) 

< -/3Uai(kl)/2)a3(k|)/2 + /3Ua2(k|)+di(|x|)/2)7(|/i(x)|). 

Recall that, because of ( 102[ ), the 7 term in the last estimate can be dropped if |x| > 3p{\h{x)\), 
so that we can write 

Lf^Vs{x)<-P[{ai{\x\)/2)as{\x\)/2 + P[{a2m^^^^^^ 
Thus V3 is a smooth UOSS-Lyapunov function, satisfying the dissipation inequality with 

asi-) :=/?;(di(-)/2)d3(-)/2 

and 

7(-) :=/3U«2(3p(-)) + di(3/.(-)))/2)7(-)- 
This completes the construction. I 
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5 Norm-observers 



As conjectured in |47] and proved in this presentation, every lOSS system admits an lOSS- 
Lyapunov function. One of the main motivations for the notion of lOSS, and for deriving 
Lyapunov characterizations, is the fact that a Lyapunov function enables us to get insights 
into the behavior of control systems. In particular, it may be useful to have an estimate of 
how far the system is from the equilibrium at any given time, and in some situations this 
"norm-estimate" is sufficient for the design of a stabilizer. We next provide a construction for 
a norm-observer in the most general case - for systems of type (|5|), assuming that we have a 
smooth UIOSS-Lyapunov function at our disposal. 



5.1 Exponential decay Lyapunov functions 

Definition 5.1 Let S be a system of type (P). A C"*^ function F : X ^ R>o is an exponential 
decay UIOSS-Lyapunov function for S if it satisfies (0) with some ai and 02 > and the following 
version of inequality (|8|) : 

VVix)- f{x,u,w) <-V{x)+ai{\u\)+a2i\h{x)\) yxeX,ueV,w£T (103) 

holds with some ai and ct2 G /C. 



Lemma 5.2 Suppose V is an UIOSS-Lyapunov function for a system S of type (^), satisfying 
inequality (|8|). Then there exists a /Coo-function p such that a function W := p o V is an 
exponential decay UIOSS-Lyapunov function for S. 



Proof. Assume that system (^) admits an UIOSS-Lyapunov function with a, (i = 1, 2) as in (|^ 
and with a, ai, (T2 as in (§). Replacing a by a o ^, we have: 

^V{x{t, u)) < -a{V{x{t, u))) + ai(|u(t)|) + a2{\y{t, u)|) (104) 
dt 

for almost all t G [0, tmax(C) ^i))- According to Lemma 12 in [33|, there exists some function p E 
/Coo which can be extended as a function to a neighborhood of [0, 00) such that p'{r)^^ > 
p(r) for all r > 0. Consider the function VF(^) := p{V{S,)). Observe that W is again proper and 
positive definite. Along any trajectory x{t) := x{t,S,,u) (with y(t) := y{t,^,u)), at any point 
where (^) holds, one has that |iy(x(t)) = p'{V{x{t)))f^V{x{t)) is upper bounded by: 

which in turn is bounded by 

- p{V{x{t)) + p'{V{xm (^_^0^|M + ai(|u(t)|) + cT2(|y(t)|)) . (105) 
Observe that when V{x{t)) > a"i(2cri(|u(t)|) + 2o-2(|y(t)|)) it holds that: 

p'{V{xm +ai(|u(t)|)+a2(|;/(t)|)') <0, (106) 
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while if instead V{x{t)) < a~^(2o-i(|u(t)|) + 2cj2(|y(t)|)), then: 

p'{V{xm{a^{\um + ^2{\y{tm < cfi(|u(t)|) + a2(|y(t)|) 



(107) 



for some /Coo-functions cfi and (72 (using here the fact that p'{s) is a continuous function). 
Combining ( |106D and ( 107 ), one concludes from the estimate (|105D on ■^W{x{t)) that 



jW{x{t)) < -W{x{t)) + a\{\um + d2{\y{t)\) 



for almost all t £ [0,tr. 



5.2 Construction of a norm observer 

Proposition 5.3 Suppose that a system T, admits an exponential decay UIOSS Lyapunov 
function V. Then the pair (S„.o, k), where 

S„.o: p = -p + ai{\u\)+a2{\y\), (108) 
with o"! and (72 as in ( |103D and k{-, •) defined by k{s,r) = s, is a norm-estimator for S. 

Proof. Assume without loss of generality that the function Q2 in the definition of V satisfies 
r < 02 (r) for all nonnegative r. 

The system (108) is ISS with respect to u and y, since it can be seen as an asymptotically 
stable linear system driven by the input ((Ti(|n|), cr2(|2/|)), so, inequality ( pT[ ) obviously holds. 
Pick any initial states ^, C of S and (|lOj ) respectively, any control u, and any disturbance w. 
Consider the resulting trajectory {x{t),p{t)) of the composite system. Property ( |103| ) implies 
that 

f^iV{x{t)) - Pit)) < -{V{x{t)) - Pit)) (109) 
for almost all t S [0, tmax('?, u, w)). Thus 

V{xit)) < p{t) + e-\V{0-C) < \p{t)\+2e-'a2m + \C\) 

(using r < a2{r)). This can be written as ( |l^ ) with p := a^^{2{-)) and P{s,t) := 
aj"^(4e"*a2(s))- ■ 

Implication |2| =^ ^ of Theorem |l| now follows from Lemma |5.2| and Proposition 5.2 . 

We now turn to the proof of implication ^ =^ [l| of Theorem |^. 

Proof. Assume that (S„.o, A;) is some norm-estimator for S. Choose any initial state ^ for S, 
any input u, disturbance w, and the special initial state C = ^or Sn.o- Then inequality ( |lll) 
becomes 

|A;(p(t,0,u,yg,u_w),y(i,^,u,w)))| < 7i (||u|[o,t] ||) + 72 (||yg,u,w|[o,t] ||) (HO) 

for all t G [0,tmax)) with some class-/C functions 71 and 72 (the /C£-term vanishes because 
C = 0). Then, combining ( |110| ) with the estimate (|l^) we get 

|x(t,e,u,w)| < /3(|e|,t) + p(|fc(p(t,0,u,y5,u,w),y(i,e,u,w))|) 

< max {2/5(1^1 ,i), 4p(7i(||u|[o,t] ||)), 4p(7i(||y5,u,w|[o,t] ||))} • 
This proves the UIOSS property for S. I 
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6 Pointers for future research 



6.1 Integral variants of UIOSS 

The UIOSS property gives uniform estimates of the states in terms of the uniform bounds on 
outputs and essential bounds on controls. A natural question to ask is what property will result 
if instead of the uniform (or essential) bounds we use other "finite energy" concepts, such as, 
for example, L'^-type norms (defined by Hffl [o-,r] ||^ = /J 7(|5(0I)^^) of inputs and/or outputs, 
where the "7's" for inputs and outputs are some appropriately chosen functions of class A^oo ? 
which depend on the system. For systems without controls, the iiUOSS property provides a 
"finite energy outputs ^ finite energy state" characterization, which is "almost" equivalent to 
UOSS (See Theorem ||). Searching for the uniform estimate of the states in terms of L'^ norms 
of inputs and outputs leads to the following definition: 

Definition 6.1 A system of type (^) is uniformly integral input-output to state stable, if there 
exist functions ax G /Coo, P £ li, and 72 G /C such that 

a,(|x(t,e,w,u)|) </3(|e|,t)+ / (7i(|u(s)|)+72(|y(s,e,w,u)|))ds (111) 

Jo 

for all ^ G X, all w and u, and all t G [0, tmax(C) u, w)). 



This general definition may be adjusted in obvious manners to all the particular cases of 
system (|5|). 

Remark 6.2 It is easy to see that estimate (|111| ) is equivalent to the following estimate (with 
different bounding functions, of course) 

|x(t,e,w,u)| <max|/3(|C|,t), 7(^ {ji{\u{s)\))ds^ , 7 (^^ 72(|y(s, w, u)|)dsj | , (112) 

□ 



In the particular case of systems without outputs and disturbances, a Lyapunov characteri- 
zation of the UilOSS property, reduced to integral input to state stability (iISS), was obtained 
in [^. By repeating the proof of the implication 1 ^ 2 of Theorem 1 in one can show 
that a system of type (|5|) will be UilOSS if it admits a smooth, proper Lyapunov function 
y : X — > -R>o, satisfying inequality (|8|) with some cJi and (T2 of class /C, and a positive definite 
function a. Whether or not this sufficient condition is also necessary for UilOSS is not known. 
Notice, however, that this condition is weaker than the corresponding property for UIOSS, as 
the dissipation condition for a UIOSS-Lyapunov function requires a to be of class /Coo- Thus, 
any UIOSS system will also be UilOSS. The converse implication is not true, as demonstrated 
in the following example. 



Example 6.3 The construction is similar to the one used in Remark 3.10, so, we recall that 
(j)e{-) denotes a C°°-bump function as in (|36|), and 1a{-) is the indicator function of a set ^4. 

Choose Ef = 0.1 and any e/j < (1 — ej)e^^, and consider the autonomous system 



x = f{x); y = h{x) 
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with 



= rr [l(_oo - (/-e^Cx + 1)) + l[i,+oo)(2;)(l - </)e^(x - 1))] 
-X [1(_1,1)(X)(1 - 0,,(X + 1))(1 - Cl)ej{x - 1))] , 

and 

hi{x) = 1 - 4>e,Sx)- 

evolving in X = M. We claim that Si is iOSS but not OSS. 
Consider also an autonomous system S2 on M with 

f2{x)=X- h2{x) = l (113) 

This system cannot serve as a counterexample, because /i2(0) 7^ 0. However, its behavior away 
from is identical to that of Si, so that considering it will simplify the presentation. 

Let i = 1,2, denote the solutions of Sj, starting at ^, and let yi{t,^) denote the 

corresponding output trajectories. It is easy to see that both Si and S2 are forward complete. 

Since the dynamics of Si and S2 are odd functions and outputs are even (but only the 
magnitudes of outputs are involved in the estimates), we only need to consider trajectories 
starting from the positive initial states, as the same estimates will work for trajectories contained 
in the other half-line. 

Since /i(x) < f2{x) for all x G (0, 1 + ej) and /i(x) = /2(x) for x > 1 + £f, we have, for all 
t > 0, xi(t,0 < X2(t,0 for any ^ G (0,1 + £/), and xi(t,0 = X2(t,0 = ^e* if \^\ >! + £/■ In 
particular, this shows that Si is not OSS, because the trajectory diverges to +00, but hi{^e^) 
is bounded. 

However, observe that when t < |^|, 

|x2(t,OI < |C|el«' <e'l«l|C|e"^, 

whereas when t > |^|, we have 

|x2(t,6l <te*- 

Letting 

P{r,t) := re"^""^; 72 := Id; -f{t) := te\ 

and noticing that 

/ 72i\y2is,0\)ds = t, 
Jo 

we conclude X2(t, C) satisfies estimate ( |112| ). 
Now observe that 

• If ^ > 1, then 1 < xi{t,^) < X2{t,i) for ah t > 0, so that yi(t,0 = 2/2(^,0 = 1 and 
xi(t, ^) satisfies ( |112| ). 

• If C G [0,1 -£/], then 

xi(t,o = ee-*</5(iei,t). 

• Finally, if ^ G (1 — ej, 1), then 

- for alH > it holds that |xi(t,0| < 1; 
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- for all t G [0, 1] it holds that ^)| > (1 — £f)e ^ > £h, so that 

Therefore xi{t,^) satisfies ( |112| ) for all t < 1 and 

t 

l2{\y2is,0\)ds>l>xi{t,C) Vt>l. 







This shows that satisfies (112) for all and t>0, thus, Si is, indeed, iOSS. 



It could also be of interest to consider yet another property, providing a uniform estimate 
for the state in terms of the uniform norm of the output and L"^ norm of the input. 

Definition 6.4 A system of type (|5|) satisfies the U(iI)OSS property if there exist functions 

ctx G ^oo, (3 G ICC, 7i, and 72 G /C such that 

a,(|a;(i,e,w,u)|) </3(|e|,i)+ / 7i(|u(5)|)ds + 72 (||y5,w,u|[o,t] ||) (114) 

Jo 

for all ^ G X, all w and u, and all t G [0, tmax(^, u, w)). 

Deriving a Lyapunov characterization for this property may be a challenge. It would be 
logical to expect that a good candidate for a U(iI)OSS-Lyapunov function can be a proper 
function 1/ : X ^ IK>o, satisfying inequality (|8|) with a being either positive definite or class 
/Coo- However, we can see right away that neither of these two possibilities is the right guess. 
Indeed, notice that both OSS and iISS are particular cases of the U(iI)OSS property. If a 
U(iI)OSS-Lyapunov function would satisfy (^) with a of class /Coo (as required by OSS), it 
would follow that every disturbance-free U(iI)OSS system without outputs is ISS, which is 
not true (see Q for an example of an iISS system, which is not ISS). On the other hand, if a 
U(iI)OSS-Lyapunov function satisfied (^) with a positive definite (as required by iISS), it would 
imply that having such a dissipation function is sufficient for OSS, which is not so, because this 
would mean that every iOSS system is OSS. 



6.2 Incremental input-output to state stability 

As mentioned in the introduction, the detectability property for nonlinear systems is not equiv- 
alent to zero-detectability. In seaching for a correct notion for nonlinear detectability one could 
think of the following generalization of UIOSS: 

Definition 6.5 A system (^ is incrementally uniformly input-output to state stable (AUIOSS) 
if there exists some /? G fCC and 71, 72 G /C such that, for every two initial states ^1 and ^2, any 
two controls ui and U2, and any disturbance w, 

|x(t,Ci,ui,w) - x{t, ^2, U2,w)| < max{/3(|^i - ^2! , t), 

71 (||(ui - U2)|[o,t]||) ,72 (||(y5i,ui,w -y6,u2,w)|[o,t]||)} (115) 

for all t in the common domain of definition. 

Deriving a right Lyapunov characterization for this property may lead to a construction of 
a full-order observer. 
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